-- Logs begin at Sat 2022-09-24 19:04:59 UTC, end at Sat 2022-09-24 20:05:39 UTC. -- Sep 24 19:36:08.357045 dv-cinder-859191-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 19:36:08.364390 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 19:36:08 2022] *** Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: nodename: dv-cinder-859191-1-iscsi Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: machine: x86_64 Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: clock source: unix Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: pcre jit disabled Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: detected number of CPU cores: 4 Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: current working directory: / Sep 24 19:36:08.367264 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: detected binary path: /usr/bin/uwsgi-core Sep 24 19:36:08.368111 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: your processes number limit is 47680 Sep 24 19:36:08.368111 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: your memory page size is 4096 bytes Sep 24 19:36:08.368111 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: detected max file descriptor number: 2048 Sep 24 19:36:08.368111 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: lock engine: pthread robust mutexes Sep 24 19:36:08.368111 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: thunder lock: enabled Sep 24 19:36:08.368411 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 19:36:08.368411 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 19:36:08.407525 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: Python main interpreter initialized at 0x56430930b9c0 Sep 24 19:36:08.407525 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: python threads support enabled Sep 24 19:36:08.407525 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: your server socket listen backlog is limited to 100 connections Sep 24 19:36:08.407525 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: your mercy for graceful operations on workers is 90 seconds Sep 24 19:36:08.407962 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 19:36:08.407962 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: *** Operational MODE: preforking *** Sep 24 19:36:08.408214 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: *** uWSGI is running in multiple interpreter mode *** Sep 24 19:36:08.408214 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: spawned uWSGI master process (pid: 112016) Sep 24 19:36:08.408434 dv-cinder-859191-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 19:36:08.409162 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: spawned uWSGI worker 1 (pid: 112017, cores: 1) Sep 24 19:36:08.409493 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: spawned uWSGI worker 2 (pid: 112018, cores: 1) Sep 24 19:36:08.409639 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 19:36:09.066231 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 19:36:09.073305 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 19:36:10.155200 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:10.155200 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: from cryptography.utils import int_from_bytes Sep 24 19:36:10.155819 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:10.155819 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: from cryptography.utils import int_from_bytes Sep 24 19:36:10.160516 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:10.160516 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: from cryptography.utils import int_from_bytes Sep 24 19:36:10.160953 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:36:10.160953 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: from cryptography.utils import int_from_bytes Sep 24 19:36:12.637932 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:36:12.638517 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:36:12.638695 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:36:12.639049 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:36:12.639299 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:36:12.639721 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.640045 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.640336 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:36:12.640756 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.640867 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:36:12.640951 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.640951 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.641105 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:36:12.641272 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.641450 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:36:12.641590 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.641694 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:36:12.641903 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.642070 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.642221 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.642393 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.642479 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.642718 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.642805 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.643034 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.643128 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859191-1-iscsi {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.643360 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.643472 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.643692 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.643789 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.643993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.644085 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.644305 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.644392 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.644606 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.644702 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.644869 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.644963 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.645179 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.645265 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.645498 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859191-1-iscsi {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.645685 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646081 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646081 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646312 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646419 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646535 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646694 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646814 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.646995 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.647108 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.647311 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.647411 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.648180 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.648323 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.648606 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.648694 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.648935 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.649094 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.649259 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.649355 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.649568 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.649665 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.649897 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.649984 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859191-1-iscsi {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.650207 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.650302 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.650510 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.650597 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.650825 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.650910 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.651130 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.651263 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.651468 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.651567 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.651771 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.651868 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.652161 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.652272 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859191-1-iscsi {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.652473 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.652645 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.652780 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.652868 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.653088 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.653174 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.653400 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.653498 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.653720 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.653838 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.654033 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.654120 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.654331 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.654428 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.654636 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.654724 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.654941 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.655035 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.655252 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.655351 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.655580 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.655690 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.655887 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.655974 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.656134 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.656270 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.656438 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.656571 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.656754 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.656886 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.657071 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.657206 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.657388 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.657533 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.657622 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.657839 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.657927 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.658142 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.658228 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.658389 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.658486 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.658696 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.658792 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659014 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659111 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659331 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659444 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659663 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659753 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659911 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.659997 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.660158 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.660264 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.660472 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.660566 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.660789 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.660876 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.661093 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.661189 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.661397 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.661502 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.661699 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.661789 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.662006 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.662118 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.662310 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.662407 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.662620 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.662714 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.662925 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.663021 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.663924 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.664025 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.664248 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.664458 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.664554 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.664785 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.664873 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.665096 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.665201 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.665411 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.665511 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.665731 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.665852 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.666038 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.666130 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.666343 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.666448 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.666644 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.666732 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.666961 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.667048 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.667289 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.667379 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.667614 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.667714 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.667863 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.667951 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.668160 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.668282 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.668468 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.668556 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.668779 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.668872 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.669086 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.669181 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.669387 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.669482 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.669688 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.669783 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.669951 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.670039 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.670249 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.670339 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.670553 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.670655 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.670854 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.670950 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.671155 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.671242 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.671473 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.671577 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.671779 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.671867 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.672076 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.672170 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.672378 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.672472 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.672675 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.672762 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.672973 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.673060 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.673276 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.673375 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.673580 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.673667 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.673879 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.673972 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.674179 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.674280 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.674476 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.674572 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.674775 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.674867 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.675079 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.675184 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.675374 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.675508 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.675698 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.675786 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.676012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.676120 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.676310 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.676397 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.676609 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.676708 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.676910 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.677006 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.677209 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.677306 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.677509 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.677597 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.677810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.677905 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.678106 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.678201 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.678411 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.678498 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.678759 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.678860 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.679151 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.679261 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.679483 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.679580 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.679792 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.679881 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.680091 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.680188 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.680389 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.680484 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.680688 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.681036 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.681250 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.681337 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.681548 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.681635 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.681843 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.681930 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.682142 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.682229 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.682448 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.682542 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.682749 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.682837 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.683049 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.683141 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.683346 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.683514 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.683670 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.683758 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.683969 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.684065 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.684284 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.684384 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.684602 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.684691 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.684909 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.684997 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.685213 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.685327 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.685512 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.685608 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.685826 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:36:12.685913 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.686140 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.686227 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.686453 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.686549 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.686771 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.686859 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.687079 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.687168 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.687384 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.687485 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.687711 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.687798 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.688025 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.688114 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.688345 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.688431 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.688657 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.688753 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.688973 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.689066 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.689280 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.689383 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.689589 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.689677 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.689891 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.689994 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.690205 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.690293 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.690526 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.690621 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.690843 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.690943 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.691150 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.691287 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.691504 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.691611 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.691846 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.691986 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.692154 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.692245 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.692473 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.692613 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.692788 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.692876 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.693095 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.693183 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.693401 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.693506 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.693704 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.693805 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.694039 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.694136 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.694408 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.694536 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.694802 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.694922 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.695142 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.695232 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.695474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.695591 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.695788 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.695881 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.696174 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.696282 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.696751 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.696853 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.696950 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.697024 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.697116 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.697199 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.697337 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.697457 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.697668 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.698116 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.698199 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.698302 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.698718 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.698853 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.698951 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699033 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699121 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699211 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699294 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699370 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699488 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699718 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.699820 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.700072 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.700163 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.700372 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.700459 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.700675 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.700766 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.700976 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.701073 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.701281 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.701376 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.701582 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.701681 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.701898 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.701990 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.702222 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.702319 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.702523 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.702690 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.702849 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.702940 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.703150 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.703238 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.703473 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.703579 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.703782 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.703870 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.704087 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.704187 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.704389 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.704493 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.704698 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.704837 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.705005 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.705163 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.705306 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.705513 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.705623 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.705837 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.705914 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.706165 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.706265 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.706472 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.706560 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.706798 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.706885 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.707099 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.707215 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.707412 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.707541 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.707737 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.707838 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.708051 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.708164 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.708364 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.708443 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.708670 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.708758 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.708988 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.709080 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.709298 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.709395 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.709605 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.709683 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.710490 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.710641 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.710812 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.710978 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.711144 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.711283 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.711612 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.711693 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.712004 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.712091 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.712254 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.712333 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.712558 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.712711 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.712866 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.713051 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.713169 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.713331 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.713471 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.713685 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.713769 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.714036 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.714124 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.714353 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.714449 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.714650 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.714728 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.714985 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.715092 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.715254 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.715342 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.715572 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.715723 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.715891 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.715996 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.716197 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.716295 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.716495 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.716617 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.716793 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.716949 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.717092 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.717269 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.717429 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.717587 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.717729 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.717965 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.718064 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.718280 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.718375 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.718542 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.718706 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.718856 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.719001 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.719184 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.719391 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.719539 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.719708 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.719831 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.719938 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.720134 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.720226 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.720456 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.720556 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.720805 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.720901 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.721123 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.721212 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.721433 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.721530 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.721748 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.721880 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.722055 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.722151 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.722373 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.722471 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.722680 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.722768 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.722995 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.723097 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.723299 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.723412 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.723633 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.723723 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.723956 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.724045 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.724267 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.724367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.724581 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.724667 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.724888 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.724975 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.725194 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.725290 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.725498 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.725655 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.726340 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.726564 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.726664 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.726882 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.726969 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.727204 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.727291 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.727534 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.727641 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.727854 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.727952 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.728163 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.728251 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.728474 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.728572 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.728794 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.728910 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.729096 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.729185 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.729411 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.729516 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.729707 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.729795 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.730018 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.730106 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.730339 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.730429 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.730647 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.730734 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.730956 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.731043 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.731262 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.731350 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.731599 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.731688 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.731908 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.731998 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.732214 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.732303 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.732520 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.732606 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.732821 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.732908 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.733123 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.733213 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.733429 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.733528 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.733737 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.733824 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.734042 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.734130 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.734347 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.734477 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.734648 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.734750 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.734957 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.735045 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.735262 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.735350 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.735582 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.735690 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.735881 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.735976 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.736188 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.736275 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.736505 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.736605 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.736812 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.736902 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.737129 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.737216 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.737441 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.737537 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.737741 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.737850 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.738038 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.738125 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.738338 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.738425 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.738649 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.738735 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.738949 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.739054 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.739249 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.739338 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.739892 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.739998 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.739998 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.740146 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.740294 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.740380 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.740516 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.740603 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.740789 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.740905 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.741105 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.741210 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.741432 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.741520 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.741742 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.741840 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.742063 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.742175 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.742435 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.742524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.742766 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.742863 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.743112 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.743207 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.743447 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.743601 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.743781 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.743879 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.744091 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.744179 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.744442 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.744530 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.744759 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.745056 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.745145 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.745369 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.745597 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.745684 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.746014 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.746102 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.746321 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.746407 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.746633 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.746721 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.746942 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.747043 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.747246 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.747332 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.747578 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.747672 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.747886 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.748151 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.748246 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.748487 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.748581 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.748801 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.748898 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.749121 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.749209 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.749463 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.749560 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.749771 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.749848 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.750072 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.750160 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.750386 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.750499 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.750696 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.750980 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.751261 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.751350 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.751605 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.751700 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.751909 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.752041 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.752214 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.752319 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.752520 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.752611 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.752822 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.752966 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.753124 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.753214 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.753425 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.753514 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.753731 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.753823 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.754032 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.754121 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.754331 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.754430 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.754629 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.754764 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.754930 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.755019 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.755240 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.755337 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.755562 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.755704 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.755865 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.755954 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.756163 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.756466 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.756562 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.756766 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.756914 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.757148 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.757266 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.757445 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.757611 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.757746 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.757835 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.758073 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.758160 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.758373 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.758468 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.758678 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.758772 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.758979 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.759079 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.759299 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.759397 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.759628 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.759717 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.759930 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.760019 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.760231 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.760384 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.760530 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.760681 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.760826 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.760960 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.761103 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.761253 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.761395 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.761526 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.761693 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.761827 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.761970 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.762099 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.762286 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.762423 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.762592 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.762739 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.762880 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.763020 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.763184 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.763314 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.763493 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.763641 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.763840 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.763967 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.764152 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.764288 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.764423 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.764557 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.764682 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.764804 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.764961 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.765090 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.765258 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.765397 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.765563 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.765693 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.765866 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.765995 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.766164 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.766310 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.766469 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.766594 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.766764 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.766889 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.767070 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.767201 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.767368 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.767520 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.767690 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.767820 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.767986 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.768120 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.768288 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.768424 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.768590 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.768716 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.768884 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.769011 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.769186 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.769311 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.769487 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.769613 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.769784 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.769911 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.770081 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.770207 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.770377 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.770522 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.770674 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.770799 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.770972 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.771104 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.771275 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.771416 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.771596 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.771746 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.771914 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.772057 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.772212 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.772358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.773040 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.773218 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.773348 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.773467 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.773632 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.773772 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.773953 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.774077 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.774210 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.774344 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.774480 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.774615 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.774787 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.774915 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.775084 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.775212 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.775383 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.775580 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.775705 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.775827 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.775996 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.776121 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.776297 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.776423 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.776593 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.776730 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.776889 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.777022 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.777189 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.777316 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.777521 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.777660 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.777817 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.777954 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.778113 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.778247 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.778410 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.778539 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.778725 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.778867 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.779026 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.779154 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.779324 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.779476 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.779646 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.779788 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.779945 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.780081 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.780267 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.780390 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.780549 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.780689 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.780854 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.780983 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.781164 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.781290 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.781464 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.781601 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.781763 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.781892 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.782081 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.782211 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.782387 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.782699 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.782830 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.783007 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.783134 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.783319 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.783487 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.783651 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.783805 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.783931 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.784040 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.784240 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.784381 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.784534 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.784660 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.784838 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.784974 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.785170 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.785300 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.785422 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.785545 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.785730 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.785966 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.786092 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.786218 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.786350 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.786474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.786626 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.786766 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.786925 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.787051 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.787224 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.787359 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.787546 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.787690 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.787849 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.787987 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.788197 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.788909 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.789046 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.789194 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.789359 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.789487 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.789668 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.789795 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.789956 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.790082 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.790268 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.790408 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.790568 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.790693 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.790873 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.791003 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.791176 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.791305 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.791512 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.791638 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.791828 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.791967 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.792131 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.792257 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.792430 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.792568 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.792736 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.792865 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.793040 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.793167 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.793346 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.793495 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.793647 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.793776 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.794072 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.794218 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.794388 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.794534 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.794670 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.794795 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.794964 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.795093 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.795261 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.795398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.795585 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.795675 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.795894 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.795981 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.796214 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.796313 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.796514 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.796592 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.796815 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.796989 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.797115 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.797313 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.797432 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.797646 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.797744 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.797981 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.798067 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.798292 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.798428 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.798611 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.798734 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.798941 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.799042 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.799284 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.799476 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.799631 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.799761 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.799957 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.800089 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.800274 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.800447 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.800600 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.800752 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.800918 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.801048 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.801252 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.801363 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.801567 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.801738 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.801872 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.802002 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.802174 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.802299 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.802492 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.802728 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.802854 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.803061 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.803183 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.803376 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.803517 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.803755 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.803872 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.804197 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.804339 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.804516 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.804652 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.804835 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.804985 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.805170 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.805293 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.805500 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.805624 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.806100 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.806251 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.806414 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.806545 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.806724 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.806815 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.807024 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.807110 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.807325 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.807415 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.807656 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.807745 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.807959 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.808046 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.808261 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.808350 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.808598 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.808733 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.808882 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.808990 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.809190 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.809314 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.809496 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.809622 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.809801 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.809939 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.810103 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.810260 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.810400 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.810580 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.810705 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.810845 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.811006 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.811167 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.811320 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.811514 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.811642 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.811840 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.811974 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.812181 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.812319 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.812504 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.812617 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.812838 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.812950 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.813140 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.813267 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.813428 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.813553 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.813729 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.813856 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.814030 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.814155 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.814354 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.814493 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.814655 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.814781 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.814969 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.815091 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.815278 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.815413 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.815632 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.815759 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.815926 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.816059 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.816227 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.816365 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.816547 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.816686 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.816850 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.816986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.817153 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.817287 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.817456 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.817564 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.817751 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.817840 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.818052 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.818141 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.818352 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.818662 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.818751 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.818962 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.819051 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.819261 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.819927 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.820128 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.820230 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.820436 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.820525 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.820737 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.821034 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.821143 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.821339 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.821458 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.821658 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.821767 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.821960 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.822072 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.822276 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.822371 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.822580 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.822681 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.822886 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.823026 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.823184 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.823279 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.823511 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.823609 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.823817 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.823924 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.824123 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.824215 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.824423 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.824511 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.824724 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.824815 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.825024 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.825113 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.825344 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.825431 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.825643 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.825734 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.825961 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.826051 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.826268 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.826358 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.826571 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.826670 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.826872 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.826963 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.827172 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.827270 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.827508 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.827598 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.827822 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.827909 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.828132 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.828233 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.828439 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.828541 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.828759 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.828967 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.829058 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.829298 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.829388 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.829608 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.829698 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.829918 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.830007 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.830226 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.830316 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.830537 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.830625 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.830847 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.830945 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.831152 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.831248 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.831482 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.831575 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.831789 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.831900 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.832095 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.832185 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.832420 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.832620 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.832738 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.832944 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.833062 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.833259 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.833392 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.833568 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.833743 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.833898 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.833999 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.834175 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.834310 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.834484 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.834623 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.834790 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.835634 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.835791 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.836042 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.836203 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.836376 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.836525 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.836694 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.836860 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.837008 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.837181 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.837322 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.837505 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.837632 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.837839 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.837937 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.838157 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.838248 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.838470 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.838568 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.838783 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.838884 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.839095 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.839193 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.839460 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.839552 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.839763 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.839864 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.840067 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.840156 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.840379 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.840468 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.840690 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.840787 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.841000 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.841088 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.841305 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.841392 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.841613 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.841705 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.841921 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.842120 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.842231 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.842432 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.842533 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.842762 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.842851 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.843085 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.843182 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.843406 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.843582 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.843739 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.843836 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.844054 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.844142 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.844377 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.844467 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.844679 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.844778 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.844982 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.845079 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.845291 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.845380 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.845599 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.845799 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.845927 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.846106 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.846205 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.846434 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.846522 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.846754 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.846853 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.847072 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.847174 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.847384 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.847522 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.847718 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.847931 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.848032 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.848277 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.848366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.848587 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.848682 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.848907 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.849015 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.849212 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.849300 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.849513 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.849602 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.849825 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.849922 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.850130 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.850218 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.850431 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.850519 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.850773 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.850940 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.851097 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.851260 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.851353 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.851686 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.851807 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.851985 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.852125 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.852291 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.852436 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.852598 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.852758 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.852898 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.853086 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.853199 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.853407 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.853505 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.853711 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.853806 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.854034 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.854139 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.854340 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.854437 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.854663 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.854762 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.854969 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.855072 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.855270 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.855368 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.855593 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.855687 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.855958 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.856049 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.856205 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.856304 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.856478 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.856569 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.856779 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.856868 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.857086 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.857184 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.857386 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.857476 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.857697 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.857786 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.858000 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.858097 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.858304 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.858393 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.858606 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.858695 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.858917 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.859008 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.859222 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.859351 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.859543 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.859634 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.859849 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.859939 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.860151 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.860240 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.860460 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.860550 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.860761 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.860856 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.861066 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.861153 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.861365 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.861452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.861676 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.861765 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.862024 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.862215 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.862333 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.862548 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.862637 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.862866 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.862955 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.863195 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.863292 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.863543 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.863637 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.863849 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.863949 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.864158 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.864304 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.864454 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.864543 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.864763 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.864851 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.865070 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.865165 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.865380 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.865470 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.865686 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.865776 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.865990 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.866265 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.866408 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.866609 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.866758 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.866921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.867037 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.867227 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.867377 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.867565 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.867736 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.867870 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.868047 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.868174 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.868354 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.868479 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.868660 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.868784 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.868982 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.869092 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.869292 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.869431 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.869603 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.869723 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.869909 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.870039 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.870217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.870352 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.870525 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.870663 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.870830 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.870978 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.871127 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.871284 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.871463 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.871614 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.871762 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.871921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.872066 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.872226 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.872371 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.872539 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.872675 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.872863 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.872983 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.873173 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.873306 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.873475 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.873594 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.873930 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.874153 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.874257 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.874471 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.874587 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.874786 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.874877 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.875107 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.875196 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.875417 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.875531 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.875755 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.875857 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.876058 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.876146 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.876365 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.876457 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.876677 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.876765 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.876981 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.877068 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.877298 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.877387 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.877600 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.877690 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.877941 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.878260 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.878349 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.878563 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.878653 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.878863 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.878951 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.879168 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.879258 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.879491 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.879586 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.879807 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.879908 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.880113 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.880203 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.880411 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.880501 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.880712 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.880810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.881015 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.881114 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.881314 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.881404 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.881613 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.881710 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.882483 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.882651 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.882817 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.882970 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.883064 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.883157 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.883367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.883508 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.883711 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.883814 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.884013 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.884112 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.884314 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.884404 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.884617 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.884718 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.884915 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.885006 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.885219 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.885315 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.885519 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.885609 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.885818 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.885913 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.886117 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.886204 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.886415 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.886503 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.886709 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.886805 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.887013 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.887100 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.887312 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.887400 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.887639 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.887737 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.887988 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.888085 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.888241 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.888340 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.888541 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.888631 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.888864 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.888958 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.889189 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.889291 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.889506 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.889637 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.889820 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.889909 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.890129 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.890223 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.890449 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.890538 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.890755 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.890843 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.891066 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.891154 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.891378 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.891486 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.891709 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.891812 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.892017 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.892115 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.892324 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.892412 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.892648 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.892735 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.892972 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.893068 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.893275 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.893364 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.893656 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.893765 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.893910 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.894001 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.894225 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.894313 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.894535 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.894648 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.894847 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.894966 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.895171 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.895311 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.895500 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.895610 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.895809 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.895904 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.896112 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.896201 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.896423 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.896572 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.896709 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.896813 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.897021 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.897111 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.897330 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.897474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.898223 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.898367 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.898501 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.898664 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.898816 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.899006 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.899146 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.899340 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.899495 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.899699 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.899866 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.900018 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.900167 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.900321 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.900416 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.900651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.900791 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.900962 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.901093 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.901299 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.901431 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.901622 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.901715 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.901929 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.902056 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.902241 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.902372 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.902540 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.902632 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.902779 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:36:12.902877 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.903187 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.903573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.903914 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.904244 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.904583 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.904926 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.905293 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.905621 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.905985 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.906331 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.906662 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.906993 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.907313 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:36:12.907596 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:36:13.055745 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO dbcounter [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Registered counter for database nova_api Sep 24 19:36:13.061689 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO dbcounter [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Registered counter for database nova_api Sep 24 19:36:13.077270 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_db.sqlalchemy.engines [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.081783 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_db.sqlalchemy.engines [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.083944 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writer thread running {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.089124 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writer thread running {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.141868 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.context [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440(cell1) {{(pid=112018) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 19:36:13.145691 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_concurrency.lockutils [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:36:13.146174 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_concurrency.lockutils [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:36:13.147256 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.context [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440(cell1) {{(pid=112017) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 19:36:13.148376 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_concurrency.lockutils [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:36:13.149109 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_concurrency.lockutils [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:36:13.149548 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_concurrency.lockutils [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:36:13.151572 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_concurrency.lockutils [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:36:13.152157 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:36:13.152625 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:36:13.153572 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO dbcounter [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Registered counter for database nova_cell0 Sep 24 19:36:13.154183 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:36:13.154902 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:36:13.155346 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:36:13.157410 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:36:13.157591 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO dbcounter [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Registered counter for database nova_cell1 Sep 24 19:36:13.159396 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO dbcounter [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Registered counter for database nova_cell0 Sep 24 19:36:13.163771 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO dbcounter [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Registered counter for database nova_cell1 Sep 24 19:36:13.167287 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_db.sqlalchemy.engines [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.170550 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_db.sqlalchemy.engines [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.171302 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_db.sqlalchemy.engines [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.172957 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_db.sqlalchemy.engines [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.175371 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writer thread running {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.176915 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writer thread running {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.179458 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writer thread running {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.182020 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writer thread running {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.324132 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO dbcounter [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Registered counter for database nova_cell0 Sep 24 19:36:13.328034 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO dbcounter [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Registered counter for database nova_cell0 Sep 24 19:36:13.333524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG oslo_db.sqlalchemy.engines [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.335127 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_db.sqlalchemy.engines [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:36:13.338501 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writer thread running {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.339689 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writer thread running {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:36:13.680465 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: WARNING keystonemiddleware.auth_token [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:36:13.682435 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: WARNING keystonemiddleware.auth_token [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:36:13.688133 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: WARNING keystonemiddleware.auth_token [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:36:13.689972 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: WARNING keystonemiddleware.auth_token [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:36:14.036173 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: WARNING keystonemiddleware.auth_token [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:36:14.039590 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: WARNING keystonemiddleware.auth_token [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:36:14.042175 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: WARNING keystonemiddleware.auth_token [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:36:14.045489 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: WARNING keystonemiddleware.auth_token [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:36:14.047478 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56430930b9c0 pid: 112018 (default app) Sep 24 19:36:14.049534 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:36:14.050715 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56430930b9c0 pid: 112017 (default app) Sep 24 19:36:14.050817 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-252c2d2f-2d5b-4332-acbb-8aa01dcb4d6e None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001718 Sep 24 19:36:14.051130 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Sat Sep 24 19:36:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:37:36.757766 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:36.758997 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Sep 24 19:37:36.759605 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:37:36.775245 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_api:SELECT=3 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:36.780771 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_cell1:SELECT=3 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:36.782839 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_cell0:SELECT=3 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:36.785367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:37.725003 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-e5a22cb2-13a5-4b21-9734-1bc86bc5596e admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:37.761007 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-e5a22cb2-13a5-4b21-9734-1bc86bc5596e admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.994411 Sep 24 19:37:37.763524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1292 bytes} [Sat Sep 24 19:37:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:40.410697 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:40.412559 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-cb71830d-1675-443f-8ea1-0bdc31bef911 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 24 19:37:40.413206 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 2/4] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:37:40.882393 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-af0c5329-fff9-4c34-a3b0-dcbf127ab177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:40.931238 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-af0c5329-fff9-4c34-a3b0-dcbf127ab177 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511222 Sep 24 19:37:40.932240 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 3/5] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:37:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:37:40.947073 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_api:SELECT=3 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:40.947943 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_cell1:SELECT=3 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:40.949950 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_cell0:SELECT=3 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:40.950736 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:41.158834 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-94289df9-fde6-4f90-86a7-16af548c1e2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:41.231300 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-94289df9-fde6-4f90-86a7-16af548c1e2d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290502 Sep 24 19:37:41.231966 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 3/6] 10.222.0.55 () {64 vars in 1336 bytes} [Sat Sep 24 19:37:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:37:43.896983 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-af0c5329-fff9-4c34-a3b0-dcbf127ab177 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:43.898029 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-af0c5329-fff9-4c34-a3b0-dcbf127ab177 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Sep 24 19:37:43.898431 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 4/7] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:37:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:37:44.565323 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-2f534d80-8969-4d2d-a7dd-d7f709993f77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "name": "ds512M"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:44.608061 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-2f534d80-8969-4d2d-a7dd-d7f709993f77 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703383 Sep 24 19:37:44.608728 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 4/8] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:37:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:37:44.621635 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-91eb5265-89e1-4f35-b622-d8bae64033b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:44.665828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-91eb5265-89e1-4f35-b622-d8bae64033b1 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047898 Sep 24 19:37:44.666547 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 5/9] 10.222.0.55 () {64 vars in 1336 bytes} [Sat Sep 24 19:37:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:37:47.312844 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-2f534d80-8969-4d2d-a7dd-d7f709993f77 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:47.313883 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-2f534d80-8969-4d2d-a7dd-d7f709993f77 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 24 19:37:47.314280 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:37:47.748865 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-3a27b2cd-09b4-40f8-a328-87b7f44c5baa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "swap": 0, "disk": 10, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:47.768029 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-3a27b2cd-09b4-40f8-a328-87b7f44c5baa admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446725 Sep 24 19:37:47.768538 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 6/11] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:37:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:37:47.781171 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-39cc1618-b033-4a22-9b87-028f9f70f541 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:47.810754 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-39cc1618-b033-4a22-9b87-028f9f70f541 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032539 Sep 24 19:37:47.811000 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 6/12] 10.222.0.55 () {64 vars in 1336 bytes} [Sat Sep 24 19:37:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:50.492605 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-3a27b2cd-09b4-40f8-a328-87b7f44c5baa admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:50.493847 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-3a27b2cd-09b4-40f8-a328-87b7f44c5baa admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Sep 24 19:37:50.494382 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 7/13] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:37:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:37:50.949058 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-781a06f6-e684-41a4-a6a6-540ab4d62d51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:50.969859 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-781a06f6-e684-41a4-a6a6-540ab4d62d51 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468998 Sep 24 19:37:50.970773 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 7/14] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:37:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:37:50.982608 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-b1b41aa8-2878-43df-be28-0107feb9c4d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:51.012579 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-b1b41aa8-2878-43df-be28-0107feb9c4d4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033507 Sep 24 19:37:51.013992 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 8/15] 10.222.0.55 () {64 vars in 1336 bytes} [Sat Sep 24 19:37:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:37:53.733652 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-781a06f6-e684-41a4-a6a6-540ab4d62d51 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:53.734665 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-781a06f6-e684-41a4-a6a6-540ab4d62d51 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 24 19:37:53.735067 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 8/16] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:37:54.179534 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-b73a6c09-42ba-4820-892d-b68e3c28184f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "disk": 20}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:54.202961 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-b73a6c09-42ba-4820-892d-b68e3c28184f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460801 Sep 24 19:37:54.203647 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 9/17] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:37:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:37:54.216344 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-f02b42e0-6721-46ef-b2ac-2319f4ad5295 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:37:54.244341 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-f02b42e0-6721-46ef-b2ac-2319f4ad5295 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032186 Sep 24 19:37:54.245231 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 9/18] 10.222.0.55 () {64 vars in 1336 bytes} [Sat Sep 24 19:37:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:37:57.487616 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-b73a6c09-42ba-4820-892d-b68e3c28184f admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:57.488659 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-b73a6c09-42ba-4820-892d-b68e3c28184f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 24 19:37:57.489073 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 10/19] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:37:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:37:57.931126 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-fc1e0847-8c64-4afe-95b9-99ee50d11e5b admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:37:57.967650 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-fc1e0847-8c64-4afe-95b9-99ee50d11e5b admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.471422 Sep 24 19:37:57.968359 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 10/20] 10.222.0.55 () {60 vars in 1292 bytes} [Sat Sep 24 19:37:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:38:00.794972 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-b73a6c09-42ba-4820-892d-b68e3c28184f admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:00.796044 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-b73a6c09-42ba-4820-892d-b68e3c28184f admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 24 19:38:00.796452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 11/21] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:38:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:01.220419 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-2b042614-2c26-42a1-bc71-ae743aff0470 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:01.242002 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-2b042614-2c26-42a1-bc71-ae743aff0470 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.438419 Sep 24 19:38:01.242546 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 11/22] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:38:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:01.254462 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-7097703e-372e-41e2-bb09-fe62605771bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:01.281744 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-7097703e-372e-41e2-bb09-fe62605771bc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030893 Sep 24 19:38:01.282649 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 12/23] 10.222.0.55 () {64 vars in 1333 bytes} [Sat Sep 24 19:38:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:03.953228 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-2b042614-2c26-42a1-bc71-ae743aff0470 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:03.955937 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-2b042614-2c26-42a1-bc71-ae743aff0470 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003157 Sep 24 19:38:03.956344 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:38:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:04.383984 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-14fd8504-6acf-4764-9966-5c7cc9e130f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "2", "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:04.406807 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-14fd8504-6acf-4764-9966-5c7cc9e130f4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.443853 Sep 24 19:38:04.407561 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 13/25] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:38:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:04.419353 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-b21a5727-2b51-4fb2-8a17-b12b1b627fa5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:04.445827 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-b21a5727-2b51-4fb2-8a17-b12b1b627fa5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030033 Sep 24 19:38:04.446533 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 13/26] 10.222.0.55 () {64 vars in 1333 bytes} [Sat Sep 24 19:38:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:07.187282 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-14fd8504-6acf-4764-9966-5c7cc9e130f4 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:07.190339 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-14fd8504-6acf-4764-9966-5c7cc9e130f4 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Sep 24 19:38:07.190339 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:38:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:07.654176 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-6a5194fd-79cf-4a08-896f-6c8fadd59740 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "disk": 40, "vcpus": 2, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:07.675176 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-6a5194fd-79cf-4a08-896f-6c8fadd59740 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479378 Sep 24 19:38:07.676323 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 14/28] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:38:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 19:38:07.688797 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-879371e5-9179-4e8c-96f5-3064407c1c19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:07.694042 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:07.718977 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-879371e5-9179-4e8c-96f5-3064407c1c19 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033780 Sep 24 19:38:07.719814 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 15/29] 10.222.0.55 () {64 vars in 1333 bytes} [Sat Sep 24 19:38:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:10.444760 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-6a5194fd-79cf-4a08-896f-6c8fadd59740 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:10.446177 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-6a5194fd-79cf-4a08-896f-6c8fadd59740 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Sep 24 19:38:10.452364 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 15/30] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:38:10 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:38:10.950679 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-28b7f459-165f-4bd0-a9c4-34c38c096d61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:10.975148 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-28b7f459-165f-4bd0-a9c4-34c38c096d61 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.521530 Sep 24 19:38:10.983314 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 16/31] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:38:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 19:38:10.987840 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-2e7c8542-b8c4-4002-8b38-f87ce360e7f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:11.014802 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-2e7c8542-b8c4-4002-8b38-f87ce360e7f2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030568 Sep 24 19:38:11.015390 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 16/32] 10.222.0.55 () {64 vars in 1333 bytes} [Sat Sep 24 19:38:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:38:13.678037 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-28b7f459-165f-4bd0-a9c4-34c38c096d61 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:13.679667 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-28b7f459-165f-4bd0-a9c4-34c38c096d61 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Sep 24 19:38:13.680314 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 17/33] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:14.138765 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-a5b3b9e2-2595-4e98-ba6a-a9acf020e994 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "id": "5"}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:14.145759 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:14.162219 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-a5b3b9e2-2595-4e98-ba6a-a9acf020e994 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.475452 Sep 24 19:38:14.162785 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 17/34] 10.222.0.55 () {64 vars in 1283 bytes} [Sat Sep 24 19:38:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:14.174948 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0a3aab13-fb90-4b6a-8a6f-57920dcc4718 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:14.202701 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0a3aab13-fb90-4b6a-8a6f-57920dcc4718 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031346 Sep 24 19:38:14.203674 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 18/35] 10.222.0.55 () {64 vars in 1333 bytes} [Sat Sep 24 19:38:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:38:30.960202 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-a5b3b9e2-2595-4e98-ba6a-a9acf020e994 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:30.961555 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-a5b3b9e2-2595-4e98-ba6a-a9acf020e994 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Sep 24 19:38:30.961555 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 18/36] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:30.974193 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:31.360705 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-9c8ae7d1-ccb1-4071-9c2c-f0efafc44166 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:31.379794 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-9c8ae7d1-ccb1-4071-9c2c-f0efafc44166 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411855 Sep 24 19:38:31.380353 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 19/37] 10.222.0.55 () {60 vars in 1292 bytes} [Sat Sep 24 19:38:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:38:32.687874 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-a5b3b9e2-2595-4e98-ba6a-a9acf020e994 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:32.688877 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-a5b3b9e2-2595-4e98-ba6a-a9acf020e994 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 24 19:38:32.689273 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 19/38] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:38:33.218025 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-f946df04-c3c6-4fa0-9b67-ff327eb34b96 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:33.224004 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.wsgi [None req-f946df04-c3c6-4fa0-9b67-ff327eb34b96 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-f946df04-c3c6-4fa0-9b67-ff327eb34b96 admin admin] Request method failure captured: Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Accept: application/json Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Accept-Encoding: gzip, deflate Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Connection: keep-alive Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Content-Length: 0 Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Host: 10.222.0.55 Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Openstack-Api-Version: compute 2.92 Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Openstack-System-Scope: None Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: User-Agent: python-novaclient Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Auth-Token: gAAAAABjL1y4LzJiqLqyQkyaAyqAnjDDwI7XG1wSfTasNXQhIpML_TGNq4MEbzKkiQoOyWz3eTy2gb_E2u5Gaj6st1oaZjT-rcuLfkgIA4q_LvnosjhobKfFCpgOZxTLUmixh1Kpbwbi0KuCFZ3-3NCPn0k8LzmUrJW15Bi-22EYVHiAfNj49g4 Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Domain-Id: None Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Domain-Name: None Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Identity-Status: Confirmed Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Is-Admin-Project: True Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Domain-Id: default Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Domain-Name: Default Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Name: admin Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Role: member,admin,reader Sep 24 19:38:33.227256 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Roles: member,admin,reader Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6d64e2847698419baef7cbb0bac87311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant: admin Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant-Name: admin Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User: admin Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Domain-Id: default Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Domain-Name: Default Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Id: 818c3ae70a684477af4280e7bbdcea2d Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Name: admin Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: method: > Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: exception: Flavor 42 could not be found. Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: action_args: {'id': '42'} Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:38:33.228828 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:33.229921 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.231367 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-f946df04-c3c6-4fa0-9b67-ff327eb34b96 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:38:33.232762 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-f946df04-c3c6-4fa0-9b67-ff327eb34b96 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.403605 Sep 24 19:38:33.232762 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 20/39] 10.222.0.55 () {60 vars in 1190 bytes} [Sat Sep 24 19:38:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:33.241468 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-4d903492-3630-45d5-b375-3284bf9c62f8 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:33.263652 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-4d903492-3630-45d5-b375-3284bf9c62f8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027852 Sep 24 19:38:33.264199 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 20/40] 10.222.0.55 () {60 vars in 1210 bytes} [Sat Sep 24 19:38:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:38:33.275109 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-e86d7bba-3b97-439e-b3bf-edefc7aa19be admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:33.298003 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-e86d7bba-3b97-439e-b3bf-edefc7aa19be admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027372 Sep 24 19:38:33.298544 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1210 bytes} [Sat Sep 24 19:38:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:38:33.308996 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-d619b68f-6b59-4ce1-ab71-c29dd8b61c45 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:33.314192 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.wsgi [None req-d619b68f-6b59-4ce1-ab71-c29dd8b61c45 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-d619b68f-6b59-4ce1-ab71-c29dd8b61c45 admin admin] Request method failure captured: Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Accept: application/json Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Accept-Encoding: gzip, deflate Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Connection: keep-alive Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Content-Length: 0 Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Host: 10.222.0.55 Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Openstack-Api-Version: compute 2.92 Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Openstack-System-Scope: None Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: User-Agent: python-novaclient Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Auth-Token: gAAAAABjL1y4LzJiqLqyQkyaAyqAnjDDwI7XG1wSfTasNXQhIpML_TGNq4MEbzKkiQoOyWz3eTy2gb_E2u5Gaj6st1oaZjT-rcuLfkgIA4q_LvnosjhobKfFCpgOZxTLUmixh1Kpbwbi0KuCFZ3-3NCPn0k8LzmUrJW15Bi-22EYVHiAfNj49g4 Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Domain-Id: None Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Domain-Name: None Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Identity-Status: Confirmed Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Is-Admin-Project: True Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Domain-Id: default Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Domain-Name: Default Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Name: admin Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Role: member,admin,reader Sep 24 19:38:33.320398 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Roles: member,admin,reader Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6d64e2847698419baef7cbb0bac87311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant: admin Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant-Name: admin Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User: admin Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Domain-Id: default Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Domain-Name: Default Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Id: 818c3ae70a684477af4280e7bbdcea2d Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Name: admin Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: method: > Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: exception: Flavor 42 could not be found. Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: action_args: {'id': '42'} Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:38:33.321658 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:33.322474 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:33.323573 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-d619b68f-6b59-4ce1-ab71-c29dd8b61c45 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:38:33.324703 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-d619b68f-6b59-4ce1-ab71-c29dd8b61c45 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.017221 Sep 24 19:38:33.324703 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 21/42] 10.222.0.55 () {60 vars in 1190 bytes} [Sat Sep 24 19:38:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:34.633026 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-e86d7bba-3b97-439e-b3bf-edefc7aa19be admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:34.634114 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-e86d7bba-3b97-439e-b3bf-edefc7aa19be admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 24 19:38:34.634515 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:35.179169 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-17cbe57d-63e4-406e-8060-49b450940b4a admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:35.184510 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.wsgi [None req-17cbe57d-63e4-406e-8060-49b450940b4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-17cbe57d-63e4-406e-8060-49b450940b4a admin admin] Request method failure captured: Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Accept: application/json Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Accept-Encoding: gzip, deflate Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Connection: keep-alive Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Content-Length: 0 Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Host: 10.222.0.55 Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Openstack-Api-Version: compute 2.92 Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Openstack-System-Scope: None Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: User-Agent: python-novaclient Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Auth-Token: gAAAAABjL1y6Qrykup1gzh6amtHPAANnSBEkzi3ipUpU9WpB9j07I68Ars6oyso_9QhNOKvfx6meygnACdZyXGJYpDjk_PGCOB4r6gz6l6HJHj-m9crJLaSfsHX_qerWSRasugqGs8bYjn9s8p42C4kp4bSEvUNlAL2d9j7z-MZWvjnHgOGWz6s Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Domain-Id: None Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Domain-Name: None Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Identity-Status: Confirmed Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Is-Admin-Project: True Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Domain-Id: default Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Domain-Name: Default Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Name: admin Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Role: member,admin,reader Sep 24 19:38:35.186009 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Roles: member,admin,reader Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6d64e2847698419baef7cbb0bac87311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant: admin Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant-Name: admin Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User: admin Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Domain-Id: default Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Domain-Name: Default Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Id: 818c3ae70a684477af4280e7bbdcea2d Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Name: admin Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: method: > Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: exception: Flavor 84 could not be found. Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: action_args: {'id': '84'} Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:38:35.187548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:35.188358 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.190018 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-17cbe57d-63e4-406e-8060-49b450940b4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:38:35.191507 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-17cbe57d-63e4-406e-8060-49b450940b4a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.405932 Sep 24 19:38:35.191507 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1190 bytes} [Sat Sep 24 19:38:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 24 19:38:35.197484 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-22b052d8-0602-4f35-b4fd-2b049b0c72fc admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:35.213095 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-22b052d8-0602-4f35-b4fd-2b049b0c72fc admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019201 Sep 24 19:38:35.213632 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 23/45] 10.222.0.55 () {60 vars in 1210 bytes} [Sat Sep 24 19:38:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:38:35.223838 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-9a7b3dba-7ab1-4feb-89c6-30863806bbff admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:35.238978 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-9a7b3dba-7ab1-4feb-89c6-30863806bbff admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019277 Sep 24 19:38:35.239536 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 23/46] 10.222.0.55 () {60 vars in 1210 bytes} [Sat Sep 24 19:38:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:38:35.248926 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0e9cf542-e876-46bf-a55f-381c79d7ddc1 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:35.254445 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.wsgi [None req-0e9cf542-e876-46bf-a55f-381c79d7ddc1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0e9cf542-e876-46bf-a55f-381c79d7ddc1 admin admin] Request method failure captured: Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Accept: application/json Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Accept-Encoding: gzip, deflate Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Connection: keep-alive Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Content-Length: 0 Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Host: 10.222.0.55 Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Openstack-Api-Version: compute 2.92 Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Openstack-System-Scope: None Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: User-Agent: python-novaclient Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Auth-Token: gAAAAABjL1y6Qrykup1gzh6amtHPAANnSBEkzi3ipUpU9WpB9j07I68Ars6oyso_9QhNOKvfx6meygnACdZyXGJYpDjk_PGCOB4r6gz6l6HJHj-m9crJLaSfsHX_qerWSRasugqGs8bYjn9s8p42C4kp4bSEvUNlAL2d9j7z-MZWvjnHgOGWz6s Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Domain-Id: None Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Domain-Name: None Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Identity-Status: Confirmed Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Is-Admin-Project: True Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Domain-Id: default Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Domain-Name: Default Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Name: admin Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Role: member,admin,reader Sep 24 19:38:35.255986 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Roles: member,admin,reader Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6d64e2847698419baef7cbb0bac87311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant: admin Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant-Name: admin Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User: admin Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Domain-Id: default Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Domain-Name: Default Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Id: 818c3ae70a684477af4280e7bbdcea2d Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Name: admin Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: method: > Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: exception: Flavor 84 could not be found. Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: action_args: {'id': '84'} Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:38:35.257651 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:35.258653 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:35.259993 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0e9cf542-e876-46bf-a55f-381c79d7ddc1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:38:35.261204 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0e9cf542-e876-46bf-a55f-381c79d7ddc1 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011999 Sep 24 19:38:35.261204 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 24/47] 10.222.0.55 () {60 vars in 1190 bytes} [Sat Sep 24 19:38:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:36.471663 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-9a7b3dba-7ab1-4feb-89c6-30863806bbff admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:36.472829 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-9a7b3dba-7ab1-4feb-89c6-30863806bbff admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Sep 24 19:38:36.473228 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 24/48] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:37.000637 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-91a50ba1-b093-4019-920c-77d2f941df60 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:37.006537 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.wsgi [None req-91a50ba1-b093-4019-920c-77d2f941df60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-91a50ba1-b093-4019-920c-77d2f941df60 admin admin] Request method failure captured: Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Accept: application/json Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Accept-Encoding: gzip, deflate Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Connection: keep-alive Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Content-Length: 0 Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Host: 10.222.0.55 Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Openstack-Api-Version: compute 2.92 Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Openstack-System-Scope: None Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: User-Agent: python-novaclient Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Auth-Token: gAAAAABjL1y8KhacE8EYZ_VC6yhPr75zYfP-TQBkYSs1nTadrp8FZJTEoi-DrUNEVn5XhCjvFM5ryA4sLockXsZTEG3olOePCSlMs1UdvehQPUQrN03vMGE5wS411-W-_1K6AO_7NfiUghu9VvVlLEoZwKTPB3mJUh4v798v8YH_ZEscsvnz3cs Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Domain-Id: None Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Domain-Name: None Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Identity-Status: Confirmed Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Is-Admin-Project: True Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Domain-Id: default Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Domain-Name: Default Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Project-Name: admin Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Role: member,admin,reader Sep 24 19:38:37.008074 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Roles: member,admin,reader Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6d64e2847698419baef7cbb0bac87311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant: admin Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-Tenant-Name: admin Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User: admin Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Domain-Id: default Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Domain-Name: Default Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Id: 818c3ae70a684477af4280e7bbdcea2d Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: X-User-Name: admin Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: method: > Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: exception: Flavor 451 could not be found. Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: action_args: {'id': '451'} Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:38:37.009583 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:37.010452 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.011524 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-91a50ba1-b093-4019-920c-77d2f941df60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:38:37.012694 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-91a50ba1-b093-4019-920c-77d2f941df60 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.396889 Sep 24 19:38:37.012694 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 25/49] 10.222.0.55 () {60 vars in 1193 bytes} [Sat Sep 24 19:38:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:37.019408 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-7e8b49bb-b23a-4f3f-98c2-98d224336a23 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:37.034073 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-7e8b49bb-b23a-4f3f-98c2-98d224336a23 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018353 Sep 24 19:38:37.034601 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 25/50] 10.222.0.55 () {60 vars in 1210 bytes} [Sat Sep 24 19:38:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:38:37.044370 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:37.060105 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019185 Sep 24 19:38:37.060878 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 26/51] 10.222.0.55 () {60 vars in 1210 bytes} [Sat Sep 24 19:38:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:38:37.070700 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-34af8ca0-f375-48ac-a4a3-281b2ee4a5ef admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:37.075709 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.wsgi [None req-34af8ca0-f375-48ac-a4a3-281b2ee4a5ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-34af8ca0-f375-48ac-a4a3-281b2ee4a5ef admin admin] Request method failure captured: Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Accept: application/json Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Accept-Encoding: gzip, deflate Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Connection: keep-alive Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Content-Length: 0 Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Host: 10.222.0.55 Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Openstack-Api-Version: compute 2.92 Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Openstack-System-Scope: None Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: User-Agent: python-novaclient Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Auth-Token: gAAAAABjL1y8KhacE8EYZ_VC6yhPr75zYfP-TQBkYSs1nTadrp8FZJTEoi-DrUNEVn5XhCjvFM5ryA4sLockXsZTEG3olOePCSlMs1UdvehQPUQrN03vMGE5wS411-W-_1K6AO_7NfiUghu9VvVlLEoZwKTPB3mJUh4v798v8YH_ZEscsvnz3cs Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Domain-Id: None Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Domain-Name: None Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Identity-Status: Confirmed Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Is-Admin-Project: True Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Domain-Id: default Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Domain-Name: Default Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Project-Name: admin Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Role: member,admin,reader Sep 24 19:38:37.077217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Roles: member,admin,reader Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_6d64e2847698419baef7cbb0bac87311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/6d64e2847698419baef7cbb0bac87311"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant: admin Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant-Id: 6d64e2847698419baef7cbb0bac87311 Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-Tenant-Name: admin Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User: admin Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Domain-Id: default Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Domain-Name: Default Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Id: 818c3ae70a684477af4280e7bbdcea2d Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: X-User-Name: admin Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: method: > Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: exception: Flavor 451 could not be found. Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: action_args: {'id': '451'} Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:38:37.078810 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:37.080012 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: ERROR nova.api.openstack.wsgi Sep 24 19:38:37.081366 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-34af8ca0-f375-48ac-a4a3-281b2ee4a5ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:38:37.082737 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-34af8ca0-f375-48ac-a4a3-281b2ee4a5ef admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011884 Sep 24 19:38:37.082737 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 26/52] 10.222.0.55 () {60 vars in 1193 bytes} [Sat Sep 24 19:38:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:38.313403 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:38.314413 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 24 19:38:38.314812 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:38:38.856413 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-06b8f340-3d2b-4e29-966f-4f80ea670b0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:38.875703 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-06b8f340-3d2b-4e29-966f-4f80ea670b0b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.425124 Sep 24 19:38:38.876160 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 27/54] 10.222.0.55 () {64 vars in 1235 bytes} [Sat Sep 24 19:38:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:40.096694 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:40.098208 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Sep 24 19:38:40.098597 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:40.627299 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-d271c7bd-151a-436a-b70b-a51e2324346c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:40.645822 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-d271c7bd-151a-436a-b70b-a51e2324346c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408538 Sep 24 19:38:40.646302 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 28/56] 10.222.0.55 () {64 vars in 1235 bytes} [Sat Sep 24 19:38:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:41.880532 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:41.881542 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 24 19:38:41.882089 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 29/57] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:42.416337 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-bf72f529-0092-4820-8479-e171cc9bd6df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:42.435251 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-bf72f529-0092-4820-8479-e171cc9bd6df admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.415552 Sep 24 19:38:42.435823 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 29/58] 10.222.0.55 () {64 vars in 1235 bytes} [Sat Sep 24 19:38:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:43.656661 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:43.657674 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 24 19:38:43.658061 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 30/59] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:44.187928 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-6a85a2aa-aaaf-4166-970a-7a0b74cdd55f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:38:44.206691 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-6a85a2aa-aaaf-4166-970a-7a0b74cdd55f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.410845 Sep 24 19:38:44.207238 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 30/60] 10.222.0.55 () {64 vars in 1235 bytes} [Sat Sep 24 19:38:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:38:45.427758 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:45.428773 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 24 19:38:45.429170 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 31/61] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:38:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:38:45.961126 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-6549086c-a4de-44e1-a24c-aea6db39c018 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:38:45.981185 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-6549086c-a4de-44e1-a24c-aea6db39c018 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.410803 Sep 24 19:38:45.981721 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 31/62] 10.222.0.55 () {60 vars in 1202 bytes} [Sat Sep 24 19:38:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:39:44.018637 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:39:44.019694 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-0118d4cb-016f-4803-8b05-81a1e81255ca admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 24 19:39:44.020091 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 931 bytes} [Sat Sep 24 19:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:39:44.030717 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.413305 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-16a0b951-5976-4b3e-9ca1-b824c69d7c45 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:39:44.434138 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-16a0b951-5976-4b3e-9ca1-b824c69d7c45 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408037 Sep 24 19:39:44.434678 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 32/64] 10.222.0.55 () {60 vars in 1292 bytes} [Sat Sep 24 19:39:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:39:44.455402 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_api:SELECT=14 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:44.459561 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-a41b7233-4c15-424a-9e3b-da4500eb93d6 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:39:44.467514 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-a41b7233-4c15-424a-9e3b-da4500eb93d6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013003 Sep 24 19:39:44.468030 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 33/65] 10.222.0.55 () {60 vars in 1283 bytes} [Sat Sep 24 19:39:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:39:44.479415 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-17a3a656-4f92-4ead-9eed-1f755437c4d6 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:39:44.487086 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-17a3a656-4f92-4ead-9eed-1f755437c4d6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011233 Sep 24 19:39:44.487633 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 33/66] 10.222.0.55 () {60 vars in 1286 bytes} [Sat Sep 24 19:39:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:39:44.498762 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:39:44.505924 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010787 Sep 24 19:39:44.506432 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 34/67] 10.222.0.55 () {60 vars in 1286 bytes} [Sat Sep 24 19:39:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:39:44.517404 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-4cbef31b-4db0-418f-a901-d09d23ff0118 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:39:44.524363 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-4cbef31b-4db0-418f-a901-d09d23ff0118 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010414 Sep 24 19:39:44.524876 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 34/68] 10.222.0.55 () {60 vars in 1283 bytes} [Sat Sep 24 19:39:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:42:44.713127 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:44.714139 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 24 19:42:44.714532 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 35/69] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:42:44.855718 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_api:SELECT=6 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:45.016549 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:45.021428 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:45.021911 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:45.022352 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:45.023066 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:45.023548 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:45.023968 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:45.056462 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-baff9d2e-6bed-42ae-a602-7d5392f3fb9f admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201912 Sep 24 19:42:45.057248 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 35/70] 10.222.0.55 () {60 vars in 1193 bytes} [Sat Sep 24 19:42:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:42:46.178887 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:46.180031 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Sep 24 19:42:46.180427 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 36/71] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:42:46.375456 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:46.378841 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:46.379347 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:46.379804 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:46.380530 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:46.380983 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:46.381401 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:46.401478 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-8c0efc7e-06cd-4472-9328-413acf2050f5 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076715 Sep 24 19:42:46.402053 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 36/72] 10.222.0.55 () {60 vars in 1193 bytes} [Sat Sep 24 19:42:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:42:57.894852 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:57.895915 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 24 19:42:57.896382 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 37/73] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:42:58.044281 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_cell0:SELECT=4 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:58.045006 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_cell1:SELECT=4 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:58.045734 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG dbcounter [-] [112017] Writing DB stats nova_api:SELECT=8 {{(pid=112017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:58.095663 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:58.099001 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:58.100180 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:58.100552 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:58.101264 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:58.101706 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:58.102120 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:58.127001 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-34fd91b8-8f2b-4207-8c48-cd04ecf3a6e5 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087284 Sep 24 19:42:58.127577 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 37/74] 10.222.0.55 () {60 vars in 1193 bytes} [Sat Sep 24 19:42:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:42:59.211279 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG nova.api.openstack.wsgi [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] Calling method '>' {{(pid=112018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:59.212343 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: INFO nova.api.openstack.requestlog [None req-708e16e1-cf8c-417e-a193-e4667ac1ef85 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 24 19:42:59.212736 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: [pid: 112018|app: 0|req: 38/75] 10.222.0.55 () {56 vars in 1074 bytes} [Sat Sep 24 19:42:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:42:59.411280 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG nova.api.openstack.wsgi [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] Calling method '>' {{(pid=112017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:42:59.414716 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:59.415217 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:59.415664 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:59.416400 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:42:59.416840 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:42:59.417251 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: DEBUG oslo_concurrency.lockutils [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:42:59.438896 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: INFO nova.api.openstack.requestlog [None req-c78f4d7e-61a2-4ccc-aecd-13441f0a8f47 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085387 Sep 24 19:42:59.439454 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: [pid: 112017|app: 0|req: 38/76] 10.222.0.55 () {60 vars in 1193 bytes} [Sat Sep 24 19:42:59 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:43:57.670607 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: Sat Sep 24 19:43:57 2022 - graceful shutdown triggered... Sep 24 19:43:57.671399 dv-cinder-859191-1-iscsi devstack@n-api.service[112017]: Gracefully killing worker 1 (pid: 112017)... Sep 24 19:43:57.671824 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: Gracefully killing worker 2 (pid: 112018)... Sep 24 19:43:57.673270 dv-cinder-859191-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 24 19:43:57.798682 dv-cinder-859191-1-iscsi devstack@n-api.service[112018]: DEBUG dbcounter [-] [112018] Writing DB stats nova_api:SELECT=4 {{(pid=112018) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:43:58.671765 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: worker 1 buried after 1 seconds Sep 24 19:43:58.672342 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: worker 2 buried after 1 seconds Sep 24 19:43:58.672342 dv-cinder-859191-1-iscsi devstack@n-api.service[112016]: goodbye to uWSGI. Sep 24 19:43:58.673407 dv-cinder-859191-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 24 19:43:58.673958 dv-cinder-859191-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 24 19:43:58.677118 dv-cinder-859191-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 19:43:58.686400 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 19:43:58 2022] *** Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: nodename: dv-cinder-859191-1-iscsi Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: machine: x86_64 Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: clock source: unix Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: pcre jit disabled Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: detected number of CPU cores: 4 Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: current working directory: / Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: detected binary path: /usr/bin/uwsgi-core Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: your processes number limit is 47680 Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: your memory page size is 4096 bytes Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: detected max file descriptor number: 2048 Sep 24 19:43:58.688559 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: lock engine: pthread robust mutexes Sep 24 19:43:58.689734 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: thunder lock: enabled Sep 24 19:43:58.689734 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 19:43:58.689734 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 19:43:58.730089 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: Python main interpreter initialized at 0x55ab82cc49c0 Sep 24 19:43:58.730089 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: python threads support enabled Sep 24 19:43:58.730089 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: your server socket listen backlog is limited to 100 connections Sep 24 19:43:58.730089 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: your mercy for graceful operations on workers is 90 seconds Sep 24 19:43:58.730800 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 19:43:58.730800 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: *** Operational MODE: preforking *** Sep 24 19:43:58.730800 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: *** uWSGI is running in multiple interpreter mode *** Sep 24 19:43:58.730800 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: spawned uWSGI master process (pid: 127032) Sep 24 19:43:58.731047 dv-cinder-859191-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 19:43:58.731569 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: spawned uWSGI worker 1 (pid: 127045, cores: 1) Sep 24 19:43:58.732081 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: spawned uWSGI worker 2 (pid: 127046, cores: 1) Sep 24 19:43:58.732361 dv-cinder-859191-1-iscsi devstack@n-api.service[127032]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 19:43:59.407347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 19:43:59.410098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 19:44:00.588862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:44:00.588862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: from cryptography.utils import int_from_bytes Sep 24 19:44:00.589496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:44:00.589496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: from cryptography.utils import int_from_bytes Sep 24 19:44:00.616333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:44:00.616333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: from cryptography.utils import int_from_bytes Sep 24 19:44:00.616915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:44:00.616915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: from cryptography.utils import int_from_bytes Sep 24 19:44:03.069009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:44:03.069009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:44:03.069682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:44:03.069682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:44:03.069870 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:44:03.070291 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.070545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.070858 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.071186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.071834 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.072160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.072496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.072829 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.073169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.073442 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.073837 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.074395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859191-1-iscsi {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.074747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.075165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.075525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.075920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.076244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.076586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.076905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.077428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.077892 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.078275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.078642 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.079005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.079344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.079749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.080134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.080796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.081554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.082125 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.082482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859191-1-iscsi {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.082849 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.083174 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.083534 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.083978 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.084303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.084624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.084956 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.085293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.085613 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.085953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.086303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.086619 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.086949 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.087259 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.087616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.087939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.088266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.088579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.088893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.089151 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.089471 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.089828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.090134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.090466 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.090724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.090981 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.091308 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.091667 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.091986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.092300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.092616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.092931 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.093249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.093566 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.093882 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.094194 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.094525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.094848 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.095180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.095527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.095860 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.096879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.097317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.097720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.098077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.098411 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.098725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.099056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.099395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.099742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.100063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.100380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.100712 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.101049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.101372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.101633 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.101943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.102262 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.102591 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.102908 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.103224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.103570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.103881 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.104288 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.104648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.104948 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.105266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.105792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.106267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.106759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.107228 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.107740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.108206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.108705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.109219 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.109543 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.109862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.110183 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.110505 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.110839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.111156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.111498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.111945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.112887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.113473 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.113827 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.114151 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.114470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.114803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.115116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.115447 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.115791 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.116111 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.116426 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.116746 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.117058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.117373 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.117688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.118000 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.118312 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.118622 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.118954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.119294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.119654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.119974 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.120287 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.120617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.120966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.121314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.121664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.121987 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.122329 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.122668 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.122997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.123318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.123675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.124015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.124334 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.124654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.124978 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.125307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.125636 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.125973 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.126298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.126629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.126957 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.127277 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.127806 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.128216 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.128555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.128878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.129230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.129588 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.129913 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.130246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.130591 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.130902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.131223 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.131570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.132011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.132347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.132687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.133055 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.133335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.133671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.134190 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.134694 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.135023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.135341 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.135687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.136043 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.136370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.136715 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.137040 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.139565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.140157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.140157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.140463 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.140783 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.141100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.141445 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.141762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.142083 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.142404 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.142723 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.143038 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.143396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.143954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.144432 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.144772 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.145096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.145416 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.145751 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.146068 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.146269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:44:03.146713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.146802 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:44:03.146884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.147069 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.147166 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:44:03.147328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.147458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:44:03.147699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.147810 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:44:03.148022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.148121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.148357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.148534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.148686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.148842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.148986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.149137 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.149325 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.149492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.149669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.149831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.149976 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.150130 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.150786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.150969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.151155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.151315 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.151315 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.151689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.151860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.152008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.152008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.152295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859191-1-iscsi {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.152468 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.152633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.152780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.152925 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.153077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.153230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.153400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.153555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.153706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.153851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.154005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.154150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.154378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.154531 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.154676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.154676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.154981 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.155162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.155320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.155487 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.155640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.155806 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.155963 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.156122 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.156275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.156426 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.156590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.156740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.156886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.158262 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.158440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.158601 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.158750 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.159448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.159600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.159761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.159916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.160070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.160215 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859191-1-iscsi {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.160367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.160927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.161131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.161292 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.161451 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.161596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.161755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.161902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.162060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.162060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.162334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.162477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.162635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.162781 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.162926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.163077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.163222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.163384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.163591 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.163739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.163884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.164038 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.164183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.164394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.164560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.164717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.164868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.165014 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.165165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.165322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.165466 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.165619 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.165773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.165918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.166070 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.166215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.166369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.166522 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.166685 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.166940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.167123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.167762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.167953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.168101 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.168518 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.168680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.168827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.168979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.169140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.169308 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.169455 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.169455 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.169732 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.169887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.170053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.170053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.170341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.170341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.170623 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.171122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.171284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.171559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.171723 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.171876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.172027 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.172186 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.172344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.172497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.172641 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.172831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.172989 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.173150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.173302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.173457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.173609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.173762 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.173916 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.174071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.174216 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.174424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.175096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.175247 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.175406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.175406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.175727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.175727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.176015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.176167 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.176321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.176321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.176604 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.176749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.176913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.177058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.177212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.177372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.177927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.178080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.178227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.178399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.178399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.178902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.179060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.179206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.179358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.179592 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.179743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.179895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.180048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.180193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.180338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.180496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.180641 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.180787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.180938 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.181965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.182127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.182289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.182453 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.182608 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.182754 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.182899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.183057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.183210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.183355 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.183533 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.183682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.183826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.183986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.184134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.184289 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.184482 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.184644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.184791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.184947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.185099 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.185252 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.185404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.185556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.185709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.185864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.186011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.186163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.186320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.186320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.186603 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.186756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.186909 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.187057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.187210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.187210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.187563 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.188211 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.188385 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.188535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.188700 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.189094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.189257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.189410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.189566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.189719 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.189872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.190092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.190242 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.190387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.190541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.190769 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.190924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.191070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.191235 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.191464 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.191629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.191791 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.191938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.191938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.191938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.192363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.192522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.192522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.192816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.193006 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.193161 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.193308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.193466 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.193623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.193768 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.193912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.194068 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.194222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.194369 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.194514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.194722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.194722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.195008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.195163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.195307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.195483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.195483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.195789 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.195935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.196079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.196221 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.196365 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.196516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.196677 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.196822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.196992 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.198592 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.198758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.198935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.199365 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.199584 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.199743 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.199899 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.200166 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:44:03.200658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.200816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.200962 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.201118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.201272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.201468 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.201658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.201950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.202125 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.202886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.203054 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.203202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.203357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.203537 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.203686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.203840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.203992 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.204156 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.204317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.204317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.204600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.204600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.204964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.205123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.205268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.205420 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.205572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.205754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.205902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.206061 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.206218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.206371 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.206568 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.206777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.206925 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.207080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.207224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.207376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.207608 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.207608 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.207990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.208915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.209164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.209406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.209767 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.210139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.210382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.210605 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.210828 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.211046 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.211271 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.211514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.211741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.211947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.212153 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.212375 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.212590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.212803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.213074 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.213287 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.213496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.213710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.213925 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.214147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.214364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.214577 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.214851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.215060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.215285 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.215536 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.215746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.215958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.215958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.216356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.216570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.216784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.216986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.216986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.217382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.217588 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.217793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.218031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.218255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.222661 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.222917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.223141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.223363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.223647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.223869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.224076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.224289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.224527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.224735 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.225058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.225307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.225524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.225749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.225966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.226194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.226421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.226636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.226856 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.227071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.227284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.227557 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.227777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.228009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.228243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.228473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.229354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.229612 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.229831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.230048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.230266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.230661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.230902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.231157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.231581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.231581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.232023 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.232251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.232487 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.232877 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.233098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.233323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.233540 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.233757 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.234087 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.234319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.234536 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.234750 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.234965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.235255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.235561 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.235784 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.236811 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.237646 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.237880 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.238115 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.238376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.238600 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.238844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.239672 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.239905 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.240147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.240384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.240635 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.240991 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.241213 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.241444 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.241691 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.241918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.242144 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.242370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.242596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.242875 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.243251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.243445 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.243631 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.243787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.243946 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.244120 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.244274 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.244427 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.244579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.244739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.244893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.245055 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.245258 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.245464 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.245638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.245638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.245948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.245948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.246247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.246400 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.246559 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.246712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.246873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.247026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.247177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.247355 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.247599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.247841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.248074 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.248299 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.248511 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.248722 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.248943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.249187 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.249964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.250199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.250463 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.250678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.250888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.251273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.251650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.251882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.252097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.252315 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.252566 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.252800 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.253011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.253245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.253614 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.253845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.254088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.254331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.254576 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.254789 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.254942 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.255095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.255306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.255505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.255700 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.255858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.256019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.256172 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.256333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.256506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.256697 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.256875 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.257070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.257070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.257393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.257554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.257709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.257860 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.258011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.258011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.258334 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.258489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.258716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.258950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.259343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.260244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.260496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.260712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.260924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.261383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.261637 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.261860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.262087 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.262310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.262529 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.262763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.265843 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.266159 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.266355 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.266516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.266670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.266824 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.266983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.267147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.267300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.267548 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.267731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.267888 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.268048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.268259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.268435 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.268597 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.268858 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.269026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.269220 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.269387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.269547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.269547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.270386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.270563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.270717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.270886 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.271054 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.271207 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.271358 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.271733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.271972 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.272292 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.272509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.272733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.272944 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.273157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.273432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.273655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.273876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.274102 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.274325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.274544 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.274775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.274984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.275205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.275537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.275793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.276169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.276399 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.276611 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.276819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.277040 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.277285 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.277514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.277738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.277965 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.278197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.278421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.278651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.278894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.279115 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.279337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.279528 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.279686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.279847 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.280170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.280713 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.280875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.281036 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.281198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.281357 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.281522 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.281703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.281703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282266 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282746 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.282833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.283001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.283137 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.283257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.283370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.283527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.283641 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.284303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.284303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.284534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.284646 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.284764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.284883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.285008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.285152 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.285346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.285516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.285745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.285927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.286090 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.286458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.286636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.286806 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.286967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.287140 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.287342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.287525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.287747 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.287747 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.288072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.288072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.288383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.288541 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.288541 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.288856 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.289015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.289185 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.289343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.289498 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.289656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.289826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.289994 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.290289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.290477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.291034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.291034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.291034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.291660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.291860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.292057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.292350 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.292540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.292709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.292884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293207 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293672 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293672 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.293923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294601 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.294941 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.295067 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.295204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.295488 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.295630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296038 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296038 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296284 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296417 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.296971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.297092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.297204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.297315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.297433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.297545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.297688 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.298418 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.298544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.298664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.298796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.298917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.299029 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.299140 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.299252 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.299389 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.300074 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.300314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.300511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.300658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301051 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301190 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301312 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301672 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.301935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.302184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.302338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.302556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.302682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.302802 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.302924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303268 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303708 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303829 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.303940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304051 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304379 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304609 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304728 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304846 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.304972 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305084 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305911 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.305911 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306186 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306420 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306653 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306765 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.306995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.307116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.307504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.307640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.307753 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.307865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.307975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.308487 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.308611 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.308746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.308861 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.308981 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309451 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309682 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309802 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.309914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.310024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.310134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.310257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.310369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.310507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.310715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.310861 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.311244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.311244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.311549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.311697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.311820 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.311941 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.312053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.312178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.312304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.312433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.312875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313716 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.313961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314192 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314312 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314425 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314671 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314791 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.314903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.315084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.315215 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.315343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.315489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.315489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.315489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.315489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.316944 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317182 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317405 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317405 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317621 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.317862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318202 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318772 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.318885 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319250 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.319900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320130 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320253 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320375 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320606 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320737 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.320924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.321050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.321050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.321537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.321651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.321762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.321873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.321984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.322105 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.322217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.322337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.322456 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.322570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.322707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.322916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323146 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323377 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323528 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.323977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324059 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324442 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324526 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324601 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324755 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324827 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.324983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325055 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325200 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325589 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.325768 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.326522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.326665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.326787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.326898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327130 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327258 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327540 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327810 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.327934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.328065 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.328280 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.328409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.328530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.328651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.328782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.328904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329017 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329358 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329589 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329700 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329811 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.329920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.330038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.330159 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.330278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.330409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.331199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.331743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.331891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332014 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332136 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332377 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332500 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.332846 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333360 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.333927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334484 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334602 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334602 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.334938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.335049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.335167 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.335286 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.335508 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.335660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.335789 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.335903 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.336114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.336114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.336396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.336524 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.336638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.336781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.336913 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337595 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.337845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.338062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.338062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.338286 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.338286 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.338727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.338840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.338967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.339726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.339897 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340028 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340143 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340264 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340490 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340601 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.340971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.341085 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.341298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.341647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.341785 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.341916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342130 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342266 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342635 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.342998 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.343231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.343354 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.343503 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.343636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.343757 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.343870 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.343982 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344214 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344463 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344581 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344693 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.344916 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345150 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345261 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345382 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345500 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345747 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345860 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.345971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.346101 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.346919 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.347108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.347333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.347530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.347695 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.347857 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.348005 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.348167 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.348323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.348470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.348624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.348779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.349029 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.349292 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.349453 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.349613 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.349760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.349906 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.350062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.350210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.350364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.350510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.350658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.350811 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.350969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.351123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.351299 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.351877 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.352054 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.352214 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.352363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.352518 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.352674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.352830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.352985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.353146 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.353410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.353572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.353728 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.353877 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.354032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.354428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.354540 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.354638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.354735 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.354830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.354918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.355016 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.355169 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.355268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.355268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.355442 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.355599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.355886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.356005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.356005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.356224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.356454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.356602 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.356743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.356934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.357075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.357214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.357355 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.357501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.357643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.357777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.357915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.358057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.358204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.358346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.358486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.358626 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.358766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.358924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.359197 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.359524 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.359662 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.359807 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.359948 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.360083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.360829 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.360980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.361124 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.361264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.361404 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.361533 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.362567 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.362718 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.362862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.363003 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.363136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.363269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.363441 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.363680 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.363825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.363959 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.364090 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.364233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.364233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.364484 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.364623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.364763 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.364895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365182 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365588 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365719 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.365996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.366368 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.366585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.366585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.366854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367024 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367299 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367715 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367849 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.367989 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.368129 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.368307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.368485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.368620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.368753 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.368885 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.369027 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.369176 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.369310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.369464 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.369688 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.369833 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.369833 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.370113 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.370247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.370379 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.370511 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.370511 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.370774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.370915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.371088 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.371222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.371363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.371525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.371675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.371968 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.372252 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.372387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.372519 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.372661 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.372805 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.372945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.373172 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.373316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.373457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.373605 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.373843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.373985 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.374124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.374257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.374387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.374531 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.374670 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.374803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.374803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:44:03.375321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.375321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.376207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.377337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.378752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.379705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.380775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.381788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.383890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.384980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.385983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.387058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.388962 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.389190 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.389590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.390009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.390239 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.390562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.390888 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.391245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.391622 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.391959 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.392289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.392608 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.392930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.393786 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.394193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.394434 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.394766 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.395114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.395452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.395778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.396222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.396549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.396881 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.397218 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.397734 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.397893 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.398187 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.398513 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.398849 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.399174 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.399550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.399906 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.400255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.400593 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.400913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.401305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.401576 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.401900 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.402330 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.402628 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.402859 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.403176 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.403521 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.403843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.404161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.404476 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.404795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.405119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.405439 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.405755 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.406095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.406381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.406695 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.407011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.407331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.407672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.407991 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.408308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.408642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.409502 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.409855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.410205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.410541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.410876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.411203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.411564 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.411892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.412233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.412665 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.412904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.413231 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.413578 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.413903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.414233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.414565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.414889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.415214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.415569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.415917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.416262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.416582 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.416922 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.417278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.417586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.417916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.418075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO dbcounter [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Registered counter for database nova_api Sep 24 19:44:03.418233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.418574 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.418901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.419226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.419570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.419895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.420220 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.420593 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.421138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.421464 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.421797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.422124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.422466 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.422841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.423118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.423477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.423822 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.424184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.424617 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.424954 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.425263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.425595 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.425923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.426317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:44:03.426486 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:44:03.438640 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.445476 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writer thread running {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:03.490895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO dbcounter [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Registered counter for database nova_api Sep 24 19:44:03.504520 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.context [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440(cell1) {{(pid=127046) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 19:44:03.508553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:44:03.509046 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:44:03.510630 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:44:03.510801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_db.sqlalchemy.engines [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.511387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:44:03.511873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:44:03.513929 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:44:03.516020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO dbcounter [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Registered counter for database nova_cell0 Sep 24 19:44:03.517396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writer thread running {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:03.520788 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO dbcounter [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Registered counter for database nova_cell1 Sep 24 19:44:03.528016 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.529774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.536875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writer thread running {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:03.538178 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writer thread running {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:03.578469 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.context [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440(cell1) {{(pid=127045) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 19:44:03.586301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:44:03.586807 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:44:03.588475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:44:03.589251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:44:03.589713 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:44:03.591808 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:44:03.593880 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO dbcounter [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Registered counter for database nova_cell0 Sep 24 19:44:03.598589 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO dbcounter [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Registered counter for database nova_cell1 Sep 24 19:44:03.606222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_db.sqlalchemy.engines [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.608549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_db.sqlalchemy.engines [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.613719 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writer thread running {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:03.616652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writer thread running {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:03.692676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO dbcounter [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Registered counter for database nova_cell0 Sep 24 19:44:03.699279 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.703725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writer thread running {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:03.771329 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO dbcounter [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Registered counter for database nova_cell0 Sep 24 19:44:03.777841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_db.sqlalchemy.engines [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:44:03.782223 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writer thread running {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:44:04.033045 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: WARNING keystonemiddleware.auth_token [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:44:04.040983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: WARNING keystonemiddleware.auth_token [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:44:04.122557 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: WARNING keystonemiddleware.auth_token [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:44:04.129988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: WARNING keystonemiddleware.auth_token [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:44:04.390203 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: WARNING keystonemiddleware.auth_token [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:44:04.397077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: WARNING keystonemiddleware.auth_token [None req-bfd7425c-1926-453c-93a4-03de1f115afd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:44:04.402633 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab82cc49c0 pid: 127046 (default app) Sep 24 19:44:04.492810 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: WARNING keystonemiddleware.auth_token [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 19:44:04.498877 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: WARNING keystonemiddleware.auth_token [None req-30a3093f-3924-4114-baf9-2e98b129700b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 19:44:04.504995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab82cc49c0 pid: 127045 (default app) Sep 24 19:44:41.664229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:41.665549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:41.666274 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:41.667028 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:43.052201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-57d2cb2a-31ab-4e70-86ba-bf6f4c338a04 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Action: 'create', calling method: .version_select at 0x7f541cbf34c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1555700984", "metadata": {"Type": "work"}}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-57d2cb2a-31ab-4e70-86ba-bf6f4c338a04 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Request method failure captured: Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 122 Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL14pMfdHe7Wl13Ia_44sg1lCrb_DguG0N5yv3jwlPuTRV4GfEIyG3U3FgweIBViPLxK0TC8CWq1WOUZtN3CFNwpL0ILwSoPvxMGRFGepfCs_SkYMNjLH8TWcIqa9OYJdsfTt4ko3KoXY-Bi8BUsKVUYPSx9DMfqna7x9Ecsgc13oxbU Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:44:43.060323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: f86526a0f95941428edbb436fd571ff4 Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1555700984", "metadata": {"Type": "work"}}} Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: Sep 24 19:44:43.061873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1555700984', 'metadata': {'Type': 'work'}}}} Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise error Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi '#$%' Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:44:43.063270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 19:44:43.066983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 19:44:43.069185 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 19:44:43.069185 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.073499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-57d2cb2a-31ab-4e70-86ba-bf6f4c338a04 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:44:43.076347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-57d2cb2a-31ab-4e70-86ba-bf6f4c338a04 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.427053 Sep 24 19:44:43.084667 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1156 bytes} [Sat Sep 24 19:44:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1436 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:44:43.090918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:43.091748 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:43.093174 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:43.096833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:44:43.497961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a3264933-1fdd-430e-99a2-6381013a837e tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Action: 'create', calling method: .version_select at 0x7f541cca8940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1411901671", "metadata": {"Type": "work"}}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a3264933-1fdd-430e-99a2-6381013a837e tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Request method failure captured: Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 120 Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL14pMfdHe7Wl13Ia_44sg1lCrb_DguG0N5yv3jwlPuTRV4GfEIyG3U3FgweIBViPLxK0TC8CWq1WOUZtN3CFNwpL0ILwSoPvxMGRFGepfCs_SkYMNjLH8TWcIqa9OYJdsfTt4ko3KoXY-Bi8BUsKVUYPSx9DMfqna7x9Ecsgc13oxbU Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:44:43.509022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: f86526a0f95941428edbb436fd571ff4 Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1411901671", "metadata": {"Type": "work"}}} Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: Sep 24 19:44:43.510691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1411901671', 'metadata': {'Type': 'work'}}}} Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise error Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi '0' Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:44:43.511879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 19:44:43.513382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 19:44:43.519896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 19:44:43.519896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.519896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a3264933-1fdd-430e-99a2-6381013a837e tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:44:43.519896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a3264933-1fdd-430e-99a2-6381013a837e tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.429078 Sep 24 19:44:43.519896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 1/2] 10.222.0.55 () {60 vars in 1156 bytes} [Sat Sep 24 19:44:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 19:44:43.525928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-35ffcc02-637c-4c13-a904-9a396b87922b tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Action: 'create', calling method: .version_select at 0x7f541cbf3dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-305067178", "metadata": {"Type": "work"}}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-35ffcc02-637c-4c13-a904-9a396b87922b tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Request method failure captured: Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 118 Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL14pMfdHe7Wl13Ia_44sg1lCrb_DguG0N5yv3jwlPuTRV4GfEIyG3U3FgweIBViPLxK0TC8CWq1WOUZtN3CFNwpL0ILwSoPvxMGRFGepfCs_SkYMNjLH8TWcIqa9OYJdsfTt4ko3KoXY-Bi8BUsKVUYPSx9DMfqna7x9Ecsgc13oxbU Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:44:43.530656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: f86526a0f95941428edbb436fd571ff4 Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-305067178", "metadata": {"Type": "work"}}} Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: Sep 24 19:44:43.532912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-305067178', 'metadata': {'Type': 'work'}}}} Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise error Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi '' Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:44:43.533951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 19:44:43.535333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 19:44:43.536454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 19:44:43.536454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:43.536454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-35ffcc02-637c-4c13-a904-9a396b87922b tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:44:43.536454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-35ffcc02-637c-4c13-a904-9a396b87922b tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011502 Sep 24 19:44:43.536454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1156 bytes} [Sat Sep 24 19:44:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:44:43.545971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-39245054-fff4-4c6f-a6d7-415e3e1b7b4d tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Calling method '.version_select at 0x7f541cc51c10>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:44:44.317289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-39245054-fff4-4c6f-a6d7-415e3e1b7b4d tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] HTTP exception thrown: Volume tempest-invalid-1172427117 could not be found. Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-39245054-fff4-4c6f-a6d7-415e3e1b7b4d tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Request method failure captured: Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1172427117 HTTP/1.1 Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL14pMfdHe7Wl13Ia_44sg1lCrb_DguG0N5yv3jwlPuTRV4GfEIyG3U3FgweIBViPLxK0TC8CWq1WOUZtN3CFNwpL0ILwSoPvxMGRFGepfCs_SkYMNjLH8TWcIqa9OYJdsfTt4ko3KoXY-Bi8BUsKVUYPSx9DMfqna7x9Ecsgc13oxbU Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:44:44.321776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: f86526a0f95941428edbb436fd571ff4 Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Volume tempest-invalid-1172427117 could not be found. Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': 'tempest-invalid-1172427117'} Sep 24 19:44:44.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1172427117 could not be found. (HTTP 404) (Request-ID: req-aaa37038-83c5-4784-be42-c58e51d420b4) Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:44.324288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 19:44:44.325642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1172427117 could not be found. Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:44:44.327121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1172427117 could not be found. Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1172427117 could not be found. Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-39245054-fff4-4c6f-a6d7-415e3e1b7b4d tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Returning 404 to user: Volume tempest-invalid-1172427117 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-39245054-fff4-4c6f-a6d7-415e3e1b7b4d tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1172427117" status: 404 len: 99 microversion: 2.1 time: 0.783378 Sep 24 19:44:44.328477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1218 bytes} [Sat Sep 24 19:44:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1172427117 => generated 99 bytes in 785 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 19:44:44.335715 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d41f756c-17ad-40f4-8488-c6de1c1f7102 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005296 Sep 24 19:44:44.336711 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 3/5] 10.222.0.55 () {58 vars in 1140 bytes} [Sat Sep 24 19:44:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 19:44:44.349025 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b0b98789-6800-49d7-b184-4d01f02f2d16 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006262 Sep 24 19:44:44.349547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 3/6] 10.222.0.55 () {58 vars in 1137 bytes} [Sat Sep 24 19:44:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 24 19:44:44.362158 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-960121de-4199-4bef-8c46-e95c9c0bd562 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Calling method '.version_select at 0x7f541caad430>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:44:45.069831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-960121de-4199-4bef-8c46-e95c9c0bd562 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] HTTP exception thrown: Volume db00536c-5a54-4867-a8a2-c420f1de3524 could not be found. Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-960121de-4199-4bef-8c46-e95c9c0bd562 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Request method failure captured: Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: DELETE /compute/v2.1/os-volumes/db00536c-5a54-4867-a8a2-c420f1de3524 HTTP/1.1 Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL14pMfdHe7Wl13Ia_44sg1lCrb_DguG0N5yv3jwlPuTRV4GfEIyG3U3FgweIBViPLxK0TC8CWq1WOUZtN3CFNwpL0ILwSoPvxMGRFGepfCs_SkYMNjLH8TWcIqa9OYJdsfTt4ko3KoXY-Bi8BUsKVUYPSx9DMfqna7x9Ecsgc13oxbU Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:44:45.073805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: f86526a0f95941428edbb436fd571ff4 Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Volume db00536c-5a54-4867-a8a2-c420f1de3524 could not be found. Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': 'db00536c-5a54-4867-a8a2-c420f1de3524'} Sep 24 19:44:45.075316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db00536c-5a54-4867-a8a2-c420f1de3524 could not be found. (HTTP 404) (Request-ID: req-f0c58c5d-9762-4f25-86e0-6ea00828d630) Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:45.076160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 19:44:45.077271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db00536c-5a54-4867-a8a2-c420f1de3524 could not be found. Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 19:44:45.078305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db00536c-5a54-4867-a8a2-c420f1de3524 could not be found. Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db00536c-5a54-4867-a8a2-c420f1de3524 could not be found. Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-960121de-4199-4bef-8c46-e95c9c0bd562 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Returning 404 to user: Volume db00536c-5a54-4867-a8a2-c420f1de3524 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:44:45.080282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-960121de-4199-4bef-8c46-e95c9c0bd562 tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/db00536c-5a54-4867-a8a2-c420f1de3524" status: 404 len: 109 microversion: 2.1 time: 0.719385 Sep 24 19:44:45.087304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-11f01e03-03a1-4687-a341-4e512a1dd20a tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Calling method '.version_select at 0x7f541ca34a60>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:44:45.092523 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:44:44 2022] DELETE /compute/v2.1/os-volumes/db00536c-5a54-4867-a8a2-c420f1de3524 => generated 109 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:44:45.120807 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-11f01e03-03a1-4687-a341-4e512a1dd20a tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] HTTP exception thrown: Volume 7f44c7ed-07cc-4c62-809b-c845ef9c4d14 could not be found. Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-11f01e03-03a1-4687-a341-4e512a1dd20a tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Request method failure captured: Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/os-volumes/7f44c7ed-07cc-4c62-809b-c845ef9c4d14 HTTP/1.1 Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL14pMfdHe7Wl13Ia_44sg1lCrb_DguG0N5yv3jwlPuTRV4GfEIyG3U3FgweIBViPLxK0TC8CWq1WOUZtN3CFNwpL0ILwSoPvxMGRFGepfCs_SkYMNjLH8TWcIqa9OYJdsfTt4ko3KoXY-Bi8BUsKVUYPSx9DMfqna7x9Ecsgc13oxbU Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:44:45.123104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ec8b2a41082e4947867cb5470a6cb87a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: ec8b2a41082e4947867cb5470a6cb87a Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesNegativeTest-940524518 Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: f86526a0f95941428edbb436fd571ff4 Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesNegativeTest-940524518-project Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Volume 7f44c7ed-07cc-4c62-809b-c845ef9c4d14 could not be found. Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '7f44c7ed-07cc-4c62-809b-c845ef9c4d14'} Sep 24 19:44:45.124422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f44c7ed-07cc-4c62-809b-c845ef9c4d14 could not be found. (HTTP 404) (Request-ID: req-633a1502-36b2-4d9e-af5c-76040ff244ff) Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:45.125236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:44:45.127278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f44c7ed-07cc-4c62-809b-c845ef9c4d14 could not be found. Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 19:44:45.129133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f44c7ed-07cc-4c62-809b-c845ef9c4d14 could not be found. Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f44c7ed-07cc-4c62-809b-c845ef9c4d14 could not be found. Sep 24 19:44:45.130948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:44:45.133013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-11f01e03-03a1-4687-a341-4e512a1dd20a tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] Returning 404 to user: Volume 7f44c7ed-07cc-4c62-809b-c845ef9c4d14 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:44:45.134040 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-11f01e03-03a1-4687-a341-4e512a1dd20a tempest-VolumesNegativeTest-940524518 tempest-VolumesNegativeTest-940524518-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/7f44c7ed-07cc-4c62-809b-c845ef9c4d14" status: 404 len: 109 microversion: 2.1 time: 0.050621 Sep 24 19:44:45.134825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:44:45 2022] GET /compute/v2.1/os-volumes/7f44c7ed-07cc-4c62-809b-c845ef9c4d14 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:44:57.685282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1176331131", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:44:57.979338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] validate_networks() for [('53423030-5132-4717-a9c9-efd8549f6319', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:44:59.191896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d8cfefa8-820c-421c-a594-04ff65e704a0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: .version_select at 0x7f541c9dd700>, body: {"keypair": {"name": "tempest-keypair-1707458177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEms4hDWAq9X6+t6RlMtPMe95KxiCEO8y7Wy6h5OcnttNwag+5UGMn3iiNKFCLtbp/p2nYdR5xtlQ3YoUxIZO75If5Yl9itfp74skHuMXldl2oIbg1inavgSYle2Ze+bQ=="}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:44:59.306428 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-d8cfefa8-820c-421c-a594-04ff65e704a0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:44:59.314877 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-d8cfefa8-820c-421c-a594-04ff65e704a0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:44:59.397597 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d8cfefa8-820c-421c-a594-04ff65e704a0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.842164 Sep 24 19:44:59.400704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 5/9] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:44:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:01.322006 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1d736613-7e8e-4610-9573-60e18a6a18f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'create', calling method: .version_select at 0x7f541c9af700>, body: {"keypair": {"name": "tempest-keypair-1153442249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWLs3q18sjvwzGp4kdFWd4VUwmoa5dOHGgazwsE0je6+oa2BJvPmv+4WciSakiagVuFss8ksxRhnvM5Mm6GBeI+pD3AFW7clKZNo29fV27PX2lzPlig3zftXzkekaro4A=="}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:01.428041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-1d736613-7e8e-4610-9573-60e18a6a18f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for project 977038321e5a41e8ab137fede4d118d7. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:01.466987 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-1d736613-7e8e-4610-9573-60e18a6a18f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for user 444719e34bf2457b9a58e182ef7fbd79 and project 977038321e5a41e8ab137fede4d118d7. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:01.552758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1d736613-7e8e-4610-9573-60e18a6a18f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.663097 Sep 24 19:45:01.557742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 6/10] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:45:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:03.146587 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-299826437", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccacbae6-4eff-4b60-b850-003263f855e0"}], "security_groups": [{"name": "tempest-securitygroup--1653420890"}], "key_name": "tempest-keypair-1707458177", "user_data": "}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:03.152792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:45:03.153914 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:45:03.154917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:45:03.155705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:45:03.157114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:45:03.190709 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:03.196276 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:03.196953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:03.202179 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:03.205725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:03.211099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:03.326022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for project 0d671773b58240b1988f7c56ec6753b5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:03.352018 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for user f417a94fed274bfbb88d23677a4877a7 and project 0d671773b58240b1988f7c56ec6753b5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:03.387766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:45:03.395708 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:45:03.440631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] validate_networks() for [('ccacbae6-4eff-4b60-b850-003263f855e0', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:45:03.593988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ca327946-8389-4275-b54d-f1eee192b5e9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.335364 Sep 24 19:45:03.598879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 5/11] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:44:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 6349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:45:03.614402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f6fdb2e9-549f-4399-9d68-5f7000f5d355 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:03.625587 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f6fdb2e9-549f-4399-9d68-5f7000f5d355 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:03.889384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f6fdb2e9-549f-4399-9d68-5f7000f5d355 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:03.996231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f6fdb2e9-549f-4399-9d68-5f7000f5d355 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1222 microversion: 2.1 time: 0.387019 Sep 24 19:45:04.024153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:03 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1222 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:04.303518 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-356830936", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "networks": [{"uuid": "08a59e3b-0d81-419d-93fb-b873f9df21df"}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:04.554912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] validate_networks() for [('08a59e3b-0d81-419d-93fb-b873f9df21df', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:45:05.822286 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:45:05.822920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:45:05.823326 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:45:05.824065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:45:05.825779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:45:05.847520 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:05.861549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:05.862179 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:05.863005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:05.863564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:05.864010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:05.923947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Getting quotas for project 0900418261fc4370bbf30ffcc668c4c5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:05.930515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Getting quotas for user 89b20ec0ede5470eaa33e1ea934991d9 and project 0900418261fc4370bbf30ffcc668c4c5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:05.961592 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:45:05.963808 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:45:06.101535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6dd68c9d-dae4-4f59-bf21-894494fd352e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074438 Sep 24 19:45:06.102743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 7/13] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:45:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:45:06.108639 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-849524959", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:06.138222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:45:06.140069 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:45:06.141271 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:45:06.142016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:45:06.142832 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:45:06.177957 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:06.180071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:06.180827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:06.187980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:06.189723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:06.195537 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:06.247809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] validate_networks() for [('53423030-5132-4717-a9c9-efd8549f6319', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:45:06.280819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:06.293834 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:06.316701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:45:06.320996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:45:06.501728 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fd298e29-a263-4230-98fc-3ad236b71dc2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.361474 Sep 24 19:45:06.502465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 7/14] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:45:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:45:07.236312 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c0b2f2f2-2721-4979-bff3-3876cc8f6bd9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'create', calling method: .version_select at 0x7f541c8a3700>, body: {"keypair": {"name": "tempest-keypair-1884035641", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE95LbVsZxe4942O8OZtsOh9XaAX9RFW2zRqWq7sMmxOV1pjt9mFxPqmZEnNQbG8tQLf89zcgxI+0V+AhAqNfRiP042mWK1qepIlfIxEdkz2qG0l580fppcGoJIP+L2hag=="}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:07.279027 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-c0b2f2f2-2721-4979-bff3-3876cc8f6bd9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:07.293986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-c0b2f2f2-2721-4979-bff3-3876cc8f6bd9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for user 6974a4c8fffd4bc2933e754770cb912e and project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:07.339095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c0b2f2f2-2721-4979-bff3-3876cc8f6bd9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.835311 Sep 24 19:45:07.340010 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 8/15] 10.222.0.55 () {62 vars in 1200 bytes} [Sat Sep 24 19:45:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 837 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 19:45:07.344529 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0e0d6242-7b1c-40f9-9c5e-e81a7c0ea64d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:07.345339 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0e0d6242-7b1c-40f9-9c5e-e81a7c0ea64d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:07.549657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0e0d6242-7b1c-40f9-9c5e-e81a7c0ea64d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:07.576098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0e0d6242-7b1c-40f9-9c5e-e81a7c0ea64d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1214 microversion: 2.1 time: 0.235238 Sep 24 19:45:07.583516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 9/16] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:07 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:07.590690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:07.602026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:07.615402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:07.615933 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:07.617948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:07.619633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:07.622418 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:07.622912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:07.722768 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:45:07.723204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:45:07.723779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:45:07.724204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:45:07.724684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:45:07.763498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:07.772786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:07.773505 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:07.784609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:07.785124 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:07.785632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:07.839803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for project 0d671773b58240b1988f7c56ec6753b5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:07.849904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for user f417a94fed274bfbb88d23677a4877a7 and project 0d671773b58240b1988f7c56ec6753b5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:07.890240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:45:07.910533 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:45:07.969709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:08.011001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-88c92558-b443-476d-8b48-acc9380a051c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1245 microversion: 2.1 time: 0.408550 Sep 24 19:45:08.017367 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 10/17] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:07 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1245 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:08.023372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-410296f4-ee86-4653-aea4-6bc9934bedea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.919301 Sep 24 19:45:08.024817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 8/18] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:45:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:45:08.036099 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a4873c9d-f877-434b-8435-653ef005e261 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:08.036655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a4873c9d-f877-434b-8435-653ef005e261 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:08.136232 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a4873c9d-f877-434b-8435-653ef005e261 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:08.153242 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a4873c9d-f877-434b-8435-653ef005e261 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1221 microversion: 2.1 time: 0.121181 Sep 24 19:45:08.153871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 11/19] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:08 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:08.301358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1429081221", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97ec7c2f-0754-40e4-8a0a-385cf50d53a8"}], "security_groups": [{"name": "tempest-securitygroup--774117653"}], "key_name": "tempest-keypair-1153442249", "user_data": "}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:08.602194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8b4dbf84-764b-4332-9f7b-83def85b3b0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:08.602933 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8b4dbf84-764b-4332-9f7b-83def85b3b0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:08.794134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8b4dbf84-764b-4332-9f7b-83def85b3b0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:08.802871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8b4dbf84-764b-4332-9f7b-83def85b3b0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1214 microversion: 2.1 time: 0.205337 Sep 24 19:45:08.809850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] validate_networks() for [('97ec7c2f-0754-40e4-8a0a-385cf50d53a8', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:45:08.818801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 12/20] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:08 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:09.043043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:09.050126 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:09.079648 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:09.089356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:09.091050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:09.121684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:09.122676 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:09.123175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:09.491502 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:09.504133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a758fd57-60ea-4bd0-ba74-870e0295b610 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1245 microversion: 2.1 time: 0.466896 Sep 24 19:45:09.510626 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 13/21] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:09 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1245 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:09.544598 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-464c3b78-3894-4e73-aa82-0b9c68ed9461 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:09.550670 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-464c3b78-3894-4e73-aa82-0b9c68ed9461 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:09.741255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-464c3b78-3894-4e73-aa82-0b9c68ed9461 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:09.760929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-464c3b78-3894-4e73-aa82-0b9c68ed9461 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1221 microversion: 2.1 time: 0.243368 Sep 24 19:45:09.765954 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 14/22] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:09 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1221 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:09.848437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:09.849342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:09.861181 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:09.869008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:09.872066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:09.873122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:09.873812 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:09.877913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:10.072806 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:10.092025 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-70c2b4bf-8a35-441b-ade7-a4c62a9d1ac4 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1210 microversion: 2.1 time: 0.248763 Sep 24 19:45:10.101064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 15/23] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:09 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1210 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:10.418615 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:45:10.419408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:45:10.419556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:45:10.419938 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:45:10.420607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:45:10.440845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:10.441386 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:10.441798 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:10.443831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:10.447074 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:10.447786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:10.497224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for project 977038321e5a41e8ab137fede4d118d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:10.507354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for user 444719e34bf2457b9a58e182ef7fbd79 and project 977038321e5a41e8ab137fede4d118d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:10.520549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:45:10.523620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:45:10.530910 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:10.532617 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:10.544178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:10.544692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:10.545483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:10.546227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:10.550760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:10.551227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:10.631674 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6cfaaf62-e147-452e-9775-49f7b6321259 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.335258 Sep 24 19:45:10.644015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 9/24] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:45:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:45:10.656673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0fe1bb7f-dac1-459d-8dfe-dba98f2c6224 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:10.658688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0fe1bb7f-dac1-459d-8dfe-dba98f2c6224 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:10.740353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:10.752093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-960c13b7-e291-4224-8124-d1d8f7fa42a1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1293 microversion: 2.1 time: 0.225599 Sep 24 19:45:10.770904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 16/25] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:10 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:10.789664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:10.789664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:10.801653 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:10.801653 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:10.804432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:10.805321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:10.805824 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:10.806295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:10.913328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0fe1bb7f-dac1-459d-8dfe-dba98f2c6224 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:10.929081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0fe1bb7f-dac1-459d-8dfe-dba98f2c6224 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1238 microversion: 2.1 time: 0.282042 Sep 24 19:45:10.930530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 10/26] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:10 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1238 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:10.974407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:10.991503 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ab12cfb1-5f3e-48a0-9296-2638a1020acd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1217 microversion: 2.1 time: 0.200615 Sep 24 19:45:10.992514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 17/27] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:10 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:11.130092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:11.132986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:11.161421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:11.165098 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:11.168066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:11.170762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:11.174049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:11.174781 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:11.775584 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:11.776206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:11.783219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:11.787028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:11.790523 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:11.791652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:11.793921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:11.796156 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:11.900071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:11.922269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:11.932772 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-42c03e12-304d-43fe-a55b-f12b69865001 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1299 microversion: 2.1 time: 0.161571 Sep 24 19:45:11.947933 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 18/28] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:11 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:11.950403 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-419bc6d4-da8a-44a4-8ff7-1eac95ec9b1c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1210 microversion: 2.1 time: 0.831456 Sep 24 19:45:11.960892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:11.961717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 11/29] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:11 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1210 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:11.962124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:11.986623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:11.990115 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:11.991054 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:11.994716 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:11.995965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:12.001149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:12.023105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:12.023813 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:12.055839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:12.067172 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:12.068500 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:12.070843 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:12.075226 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:12.079168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:12.273115 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:12.290553 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ff7cc672-3f1a-4986-9bc4-b4c6431f43ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1242 microversion: 2.1 time: 0.338570 Sep 24 19:45:12.307123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 19/30] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:11 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1242 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:12.888426 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:12.903109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-922d3098-eca7-45c1-9f91-edeac331d804 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1217 microversion: 2.1 time: 0.884430 Sep 24 19:45:12.906547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 12/31] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:12 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1217 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:12.959040 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:12.959723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:12.982206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:12.984939 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:12.991778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:12.992545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:12.992696 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:12.995464 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:12.998364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:13.001237 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:13.008686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:13.012447 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:13.013156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:13.016620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:13.018947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:13.020928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:13.272245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:13.285555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e7cbf9fc-ef3d-42e4-b006-ce4d171bbaf1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1299 microversion: 2.1 time: 0.327737 Sep 24 19:45:13.286529 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 20/32] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:12 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1299 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:13.333959 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:13.334668 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:13.353446 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:13.353959 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:13.354414 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:13.358269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:13.359891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:13.360179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:13.565231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:13.578205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4f44e9b5-21e6-4dd2-a4f8-d4b3208abf20 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1266 microversion: 2.1 time: 0.591641 Sep 24 19:45:13.604929 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 13/33] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:12 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1266 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:13.936215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:13.937879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:13.949941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:13.950484 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:13.951045 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:13.952142 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:13.953260 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:13.962691 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:14.186468 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:14.206372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-81b70b74-d807-4f52-92eb-c64d0971bf8c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1234 microversion: 2.1 time: 0.876471 Sep 24 19:45:14.210183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 21/34] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:13 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1234 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:14.230776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1705277377", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27f97536-f5bb-41f3-be68-984bbab5d462"}], "security_groups": [{"name": "tempest-securitygroup--1117118798"}], "key_name": "tempest-keypair-1884035641", "user_data": "}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:14.310489 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:14.327658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7e7a6d52-8479-4a55-bb0e-aa437391c589 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1217 microversion: 2.1 time: 0.396716 Sep 24 19:45:14.328371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 14/35] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:13 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1217 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:14.333430 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:14.334132 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:14.344919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:14.354842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:14.357288 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:14.358331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:14.361875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:14.362665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:14.537839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:14.544592 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] validate_networks() for [('27f97536-f5bb-41f3-be68-984bbab5d462', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:45:14.578923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cb41e2ac-669f-4cf5-b03e-3480a85de8b6 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1299 microversion: 2.1 time: 0.243923 Sep 24 19:45:14.580434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 15/36] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:14 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1299 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:14.615857 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:14.619556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:14.641575 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:14.642405 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:14.643015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:14.644234 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:14.645564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:14.650680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:14.803013 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:14.820852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0d6bb51b-a4fa-4d9b-8a8a-43040ce8fa4c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1266 microversion: 2.1 time: 0.221570 Sep 24 19:45:14.822610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 16/37] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:14 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:15.252482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:15.253310 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:15.262733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.270810 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.271439 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.272330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.273740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.275194 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.489908 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:15.504858 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-174b24bc-c047-4a5a-858f-3c1ed9e684c4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1234 microversion: 2.1 time: 0.256956 Sep 24 19:45:15.510841 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 17/38] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:15 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1234 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:15.524232 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:15.530805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:15.570185 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.570803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.571767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.573584 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.574940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.582198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.591047 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:45:15.591609 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:45:15.592128 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:45:15.592555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:45:15.592976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:45:15.616000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.623732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.625921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.642294 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.643055 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.643694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.697027 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:45:15.714320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for user 6974a4c8fffd4bc2933e754770cb912e and project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:45:15.723175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:15.750030 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:45:15.752714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:45:15.818001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:15.830508 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-21863802-ddfc-4dec-9491-c6f0f1fff575 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1217 microversion: 2.1 time: 0.317804 Sep 24 19:45:15.833840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 18/39] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:15 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1217 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:15.838931 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:15.845165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:15.854511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-05a7aad6-dc06-4f69-a7ce-92c3371723ca tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.642637 Sep 24 19:45:15.855479 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 22/40] 10.222.0.55 () {62 vars in 1188 bytes} [Sat Sep 24 19:45:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 19:45:15.866960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.867596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.868051 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.868784 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.869261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.869697 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.879768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:15.881712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:15.934284 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.934559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.935017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:15.935789 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:15.936405 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:15.936923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:16.164979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:16.180662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-34cbab56-9e6c-42d5-861b-3b777f37ba32 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1266 microversion: 2.1 time: 0.315991 Sep 24 19:45:16.183913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 23/41] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:15 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:16.209911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-cd8364c9-35fa-4cb8-8683-f9e9433637ab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:16.212360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-cd8364c9-35fa-4cb8-8683-f9e9433637ab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:16.391031 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cd8364c9-35fa-4cb8-8683-f9e9433637ab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:16.415566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cd8364c9-35fa-4cb8-8683-f9e9433637ab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:16.419486 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cd8364c9-35fa-4cb8-8683-f9e9433637ab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:16.425777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-cd8364c9-35fa-4cb8-8683-f9e9433637ab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1282 microversion: 2.20 time: 0.237952 Sep 24 19:45:16.441150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 24/42] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:16 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1282 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:16.542128 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:16.543230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:16.575220 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:16.578792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:16.579623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:16.583041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:16.585175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:16.587892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:16.866953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:16.883224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-fc5655a8-f1ef-4b4a-90c8-fb5f808afaef tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 1.048121 Sep 24 19:45:16.885621 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 19/43] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:15 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:16.903482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:16.923835 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:16.924609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:16.941881 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d1a3011c-fcd2-45c4-b07e-3b5f21a496ec tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1234 microversion: 2.1 time: 0.407229 Sep 24 19:45:16.946818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 25/44] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:16 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1234 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:16.962953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:16.963537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:16.964286 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:16.965133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:16.965607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:16.971092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:17.210447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:17.211090 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:17.236185 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:17.237108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:17.239921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:17.247402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:17.248886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:17.251946 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:17.273940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:17.284914 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f96233e2-0338-4d33-b27f-2b58e1cc439b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1273 microversion: 2.1 time: 0.395780 Sep 24 19:45:17.297243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 20/45] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:16 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1273 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:17.459736 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:17.460418 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:17.472281 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:17.472786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:17.473428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:17.494010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:17.494972 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:17.496683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:17.662550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:17.676572 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e23aa319-8dd1-4a87-8ff2-5dd72625735e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1272 microversion: 2.1 time: 0.470476 Sep 24 19:45:17.679842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 26/46] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:17 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:17.843112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:17.857720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:17.863893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:17.866835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0a5f4276-5ce0-4600-b24c-34655300366a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.410513 Sep 24 19:45:17.879473 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 21/47] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:17 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:45:17.915834 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:17.916526 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:17.935014 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:17.935804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:17.938238 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:17.953676 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:17.957856 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:17.960917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:17.976237 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:17.978127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:18.002145 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:18.002660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:18.014056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:18.023742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:18.024307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:18.024754 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:18.927143 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:18.944915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9f57d41b-4511-4413-b697-96522a2dac41 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1234 microversion: 2.1 time: 0.969244 Sep 24 19:45:18.955460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 22/48] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:17 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1234 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:18.962862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:18.962862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:18.967797 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:18.981629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:18.982135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:18.982608 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:18.983337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:18.983899 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:18.984430 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:19.184617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:19.202388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b5160eb7-c90b-4ceb-a44f-75366c9d88a7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.255165 Sep 24 19:45:19.206490 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 23/49] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:18 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:19.211895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:19.221355 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:19.222407 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:19.222672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b5caef14-06e6-46f9-96d8-869efb195985 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 1.311826 Sep 24 19:45:19.228442 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 27/50] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:17 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:19.237696 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:19.238200 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:19.241475 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:19.245321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:19.248128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:19.248648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:19.254079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:19.254751 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:19.262756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:19.263269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:19.263776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:19.264510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:19.265548 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:19.274720 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:19.667266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:19.684745 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7359888c-9386-42f0-938c-bb2c068c8ab2 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.475303 Sep 24 19:45:19.714070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 24/51] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:19 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:19.762209 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:19.802808 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:19.804597 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:19.819343 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c6bfdaff-ce56-4027-a707-f9efb9e2ed32 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.571121 Sep 24 19:45:19.850394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 28/52] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:19 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:19.975608 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:19.977066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:19.984275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:19.985136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:19.985793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:19.986777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:19.987473 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:19.988153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.176118 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:20.195165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-fded4237-9d33-4290-ab10-156c9215888d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.227540 Sep 24 19:45:20.215325 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 25/53] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:19 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:20.236299 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:20.236964 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:20.257571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:20.257866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.258191 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:20.258376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.258826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.259623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.271847 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.272454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.273818 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.274317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.274754 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.279824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.281451 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.286341 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.309089 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:20.474138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=8 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:20.562168 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:20.571614 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c0124151-9ded-4870-811e-11fec1f64963 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.341598 Sep 24 19:45:20.578361 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 29/54] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:20 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:20.722336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:20.723208 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:20.723879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:20.732906 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f1d68d5d-305f-45e8-8936-6f1cbefe3b98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.479126 Sep 24 19:45:20.747902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.747902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.747902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.747902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.748258 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.748258 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.753807 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 26/55] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:20 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:20.846120 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:20.847107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:20.861856 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.862830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.863495 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.864447 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:20.865109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:20.865746 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:20.938659 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=28 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:20.994070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:21.010669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:21.020906 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:21.024498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6b69fec2-638b-4629-8f59-f46cd495b3e0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.182548 Sep 24 19:45:21.046884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 27/56] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:20 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:21.180968 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:21.186693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:21.197312 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9162f5e3-7e13-462a-8a36-f31de2b9506c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.480091 Sep 24 19:45:21.198031 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 30/57] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:20 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:21.232670 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:21.233303 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:21.257818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.258434 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.258902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.259666 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.260133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.260607 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.350279 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:21.363115 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4bc160d5-c691-4c2e-bd94-8aec3224d701 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.140401 Sep 24 19:45:21.375828 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 31/58] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:21 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:21.454494 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-f3ca240d-2953-4e24-b50c-87169918277e req-faabc293-5c33-4098-97e7-95eb376fa6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80229451-4d17-4bee-9b50-a0cc56402c62", "tag": "1cf67c9e-a9bb-4997-90fc-1e81d09b909e"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:21.488004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-f3ca240d-2953-4e24-b50c-87169918277e req-faabc293-5c33-4098-97e7-95eb376fa6ff service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.488499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-f3ca240d-2953-4e24-b50c-87169918277e req-faabc293-5c33-4098-97e7-95eb376fa6ff service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.488934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-f3ca240d-2953-4e24-b50c-87169918277e req-faabc293-5c33-4098-97e7-95eb376fa6ff service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.520921 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-f3ca240d-2953-4e24-b50c-87169918277e req-faabc293-5c33-4098-97e7-95eb376fa6ff service nova] Creating event network-changed:1cf67c9e-a9bb-4997-90fc-1e81d09b909e for instance 80229451-4d17-4bee-9b50-a0cc56402c62 on hv-cinder-85919 Sep 24 19:45:21.522388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-f3ca240d-2953-4e24-b50c-87169918277e req-faabc293-5c33-4098-97e7-95eb376fa6ff service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 19:45:21.522983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-f3ca240d-2953-4e24-b50c-87169918277e req-faabc293-5c33-4098-97e7-95eb376fa6ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=127046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 19:45:21.524658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.525348 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.527165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.528277 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.528962 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.529669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.544861 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.compute.rpcapi [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 19:45:21.546124 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] Releasing lock "compute-rpcapi-router" {{(pid=127046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 19:45:21.572338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d889f5c0-a99a-4856-b8e4-ccd656c9040c None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358996 Sep 24 19:45:21.574428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 28/59] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:21.608464 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:21.610633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:21.626035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.628028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.630694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.635206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.636507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.637005 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.762798 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:21.764020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:21.780271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.781846 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.783502 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.784256 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:21.784733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:21.785165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:21.801102 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:21.829446 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-da4bf138-841c-4e53-bada-572a1b620a86 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.227548 Sep 24 19:45:21.831450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 32/60] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:21 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:22.060996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:22.062305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:22.087341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.089154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.089862 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.093795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.094922 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.096092 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.143401 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:22.157469 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-73dee9dc-dfb2-484d-b90d-7637c177bde2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.399969 Sep 24 19:45:22.158114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 29/61] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:21 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:22.206969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:22.224038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:22.226731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:22.232593 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-bff78841-b51c-46c1-992e-01b5ff30b4ec tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.181544 Sep 24 19:45:22.234863 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 33/62] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:22 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:22.262251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:22.263285 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:22.279684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.284431 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.285191 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.285940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.286419 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.286847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.388539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:22.390483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:22.404544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.417539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.418421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.419368 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.420290 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.420910 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.630851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:22.649806 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b461dfbb-3379-41f9-91f6-29b0cb22165e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.265643 Sep 24 19:45:22.650371 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 34/63] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:22 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:22.709359 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:22.732793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1f43b4cb-8116-436d-914b-31290b1b654c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.511701 Sep 24 19:45:22.733385 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 30/64] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:22 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:22.855452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:22.856083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:22.864895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.865746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.866377 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.867101 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:22.867802 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:22.868460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:22.961608 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:22.979154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6a4bcd66-3075-4136-89eb-848eac5f79f5 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.127814 Sep 24 19:45:22.995995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 35/65] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:22 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:23.180969 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:23.182471 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:23.190170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.190996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.191680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.192614 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.193154 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.193652 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.262593 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:23.263210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:23.270305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.270305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.270495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.271240 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.271675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.272030 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.365339 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:23.379613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:23.385618 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:23.387303 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-34fd08ce-4b60-4b6d-bb58-c73a3b00854c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.128764 Sep 24 19:45:23.388046 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 36/66] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:23 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:23.428398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:23.436607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1a654347-70c8-4a4b-b048-4949273fd97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.259515 Sep 24 19:45:23.438156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 31/67] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:23 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:23.600145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-d6ec9d1e-a390-434f-ae09-a9fe8cb411e7 req-62878bed-5104-41e4-8a77-9eace0f61306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc80c86-d224-4d77-9985-9658a8c0a47b", "tag": "c1ba06bb-5a83-4d65-b2c1-1ee23f4fb7dd"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:23.613126 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d6ec9d1e-a390-434f-ae09-a9fe8cb411e7 req-62878bed-5104-41e4-8a77-9eace0f61306 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.613605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d6ec9d1e-a390-434f-ae09-a9fe8cb411e7 req-62878bed-5104-41e4-8a77-9eace0f61306 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.614035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d6ec9d1e-a390-434f-ae09-a9fe8cb411e7 req-62878bed-5104-41e4-8a77-9eace0f61306 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.634236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-d6ec9d1e-a390-434f-ae09-a9fe8cb411e7 req-62878bed-5104-41e4-8a77-9eace0f61306 service nova] Creating event network-changed:c1ba06bb-5a83-4d65-b2c1-1ee23f4fb7dd for instance afc80c86-d224-4d77-9985-9658a8c0a47b on hv-cinder-85919 Sep 24 19:45:23.634756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d6ec9d1e-a390-434f-ae09-a9fe8cb411e7 req-62878bed-5104-41e4-8a77-9eace0f61306 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 19:45:23.635145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d6ec9d1e-a390-434f-ae09-a9fe8cb411e7 req-62878bed-5104-41e4-8a77-9eace0f61306 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 19:45:23.636189 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.636647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.637073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.637773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.638221 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.638638 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.647392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.compute.rpcapi [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 19:45:23.648276 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] Releasing lock "compute-rpcapi-router" {{(pid=127045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 19:45:23.681318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:23.681892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ed46c8a8-ab6f-4326-ae5c-500580a5fa25 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084181 Sep 24 19:45:23.682545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:23.687586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 37/68] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:23.691453 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.692211 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.692653 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.693538 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.694537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.695573 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.760587 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:23.761732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:23.769727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.770692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.771655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.779547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:23.781193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:23.784417 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:23.785643 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:23.810516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8a41ec95-5ed9-49c5-bbff-7d30711297bf tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.133445 Sep 24 19:45:23.818023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 32/69] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:23 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:24.007641 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:24.008434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:24.029202 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.029919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.031308 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.032301 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.032958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.041970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.116322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:24.126356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-742aa533-8792-43ef-a31c-c2872372bfa8 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.369629 Sep 24 19:45:24.127580 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 38/70] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:23 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:24.167654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:24.182252 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7a48fdb2-ba1e-4f29-98ea-371fec41153f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.179199 Sep 24 19:45:24.184754 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 33/71] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:24 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:24.422499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:24.423238 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:24.435088 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.439237 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.439785 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.440664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.441103 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.446872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.461602 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:24.462230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:24.481829 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.482340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.482804 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.491121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.491812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.492711 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.561956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:24.574094 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:24.576542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:24.579081 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-19de8226-c84c-4914-aea2-99052552e43d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.161910 Sep 24 19:45:24.604071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 39/72] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:24 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:24.770235 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:24.779023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-85da7259-a1e1-408b-971b-4daa73b71034 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.321214 Sep 24 19:45:24.779922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 34/73] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:24 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:24.840138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:24.840773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:24.847089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.847629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.848635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.849874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:24.854364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:24.855222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:24.933060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:24.945916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-aa468c5a-c4a3-40fd-86c0-25a3e041f411 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.110248 Sep 24 19:45:24.947058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 40/74] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:24 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:25.154034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:25.155225 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:25.164299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.165084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.165707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.166670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.167380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.168177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.217327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:25.218445 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:25.233211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.235095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.241222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.242742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.243310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.243793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.388273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:25.400957 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f0ff7737-c948-4561-bb55-625b9ed54347 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.191375 Sep 24 19:45:25.401742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 41/75] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:25 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:25.406394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:25.417580 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-676dac90-a8d1-48aa-901b-3cb8243c4789 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.267058 Sep 24 19:45:25.421022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 35/76] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:25 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:25.613506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:25.614883 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:25.623035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.625757 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.626663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.627452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.628828 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.633491 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.764366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:25.780964 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:25.782845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:25.784034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9aa87c04-3dff-484d-a8b7-5475f9022bf1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.175202 Sep 24 19:45:25.784583 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 42/77] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:25 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:25.803986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:25.804605 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:25.816860 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.823840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.824405 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.825175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.825655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.826096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.973874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:25.974496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:25.986485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.993147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:25.994474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:25.995551 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:25.996398 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:26.004585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:26.128271 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:26.137859 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-47577c3b-1d7b-4841-929b-b353ab83d9ff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.169980 Sep 24 19:45:26.138432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 43/78] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:25 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:26.189131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:26.210640 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cb07a881-4bba-4913-a736-66438d63f57f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.411346 Sep 24 19:45:26.211285 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 36/79] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:25 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:26.432467 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:26.445174 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:26.446299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:26.446934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:26.447287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=34 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:26.453008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:26.454887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:26.454887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:26.455053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:26.455548 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:26.456263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:26.464600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:26.464600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:26.464932 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:26.469892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:26.470596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:26.471203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:26.579965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:26.596378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-713552b0-7b09-435d-8312-9b128806271d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.174419 Sep 24 19:45:26.597424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 44/80] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:26 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:26.707037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:26.721835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-148dfd4f-560c-4f36-aec3-b38e7054b318 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.281523 Sep 24 19:45:26.722652 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 37/81] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:26 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:26.811873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:26.813525 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:26.819925 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:26.820546 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:26.821051 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:26.821836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:26.822491 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:26.822920 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:26.894384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:26.908331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:26.910445 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:26.912148 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2df84b0c-0d70-4a17-9ed8-a43fa58b81f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.104373 Sep 24 19:45:26.912982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 45/82] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:26 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:27.168785 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:27.169677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:27.191756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.192344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.192855 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.193638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.194168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.194662 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.236898 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:27.237660 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:27.250281 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.251700 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.252486 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.253424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.254621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.255349 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.294337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:27.311020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8c55ca90-89e3-4ef3-b512-62f4a13022af tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.147010 Sep 24 19:45:27.314331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 38/83] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:27 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:27.442075 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:27.457494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3ed7e2ed-a98f-4311-b4d7-4456cbbe6c83 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.225444 Sep 24 19:45:27.458291 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 46/84] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:27 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:27.620965 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:27.621743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:27.635582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.636585 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.636722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.637430 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.637901 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.643471 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.747630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:27.748512 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:27.755210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.755833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.756154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.756860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.757321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.757754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.835545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:27.854105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-794cea7d-096a-4994-90a7-5e7add17f4b8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.237163 Sep 24 19:45:27.855974 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 39/85] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:27 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:27.942399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:27.943922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:27.950990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:27.957206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:27.959599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.961825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.962068 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8b7ea543-12be-4e36-8f37-1371b086a28f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.220359 Sep 24 19:45:27.962470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:27.963197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 47/86] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:27 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:27.975643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:27.975643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:27.975643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:28.186065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:28.197771 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:28.199624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:28.201100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9e105c53-f893-4973-a257-73ae2e404909 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1278 microversion: 2.20 time: 0.267074 Sep 24 19:45:28.202058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 40/87] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:27 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:28.336293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:28.337062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:28.346911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:28.347410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:28.347871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:28.348571 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:28.349032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:28.349565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:28.483044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:28.484218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:28.501000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:28.505303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:28.507097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:28.508264 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:28.511013 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:28.513680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:28.517085 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:28.527848 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-270ddbca-4138-4438-aa1e-c938945834de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1290 microversion: 2.1 time: 0.195122 Sep 24 19:45:28.528802 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 48/88] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:28 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1290 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:28.879004 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:28.879667 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:28.891739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:28.892247 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:28.894569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:28.897855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:28.898501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:28.899157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:29.103093 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:29.116470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-975ab46c-2544-4921-b900-7206a7736f1c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.639762 Sep 24 19:45:29.135610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 41/89] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:28 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:29.144373 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:29.144988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:29.162405 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:29.162924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:29.163369 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:29.164112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:29.168550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:29.169012 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:29.206965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:29.215566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9137d667-52b1-4723-b5bb-dd88d43dbd55 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1279 microversion: 2.1 time: 0.340992 Sep 24 19:45:29.229134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 49/90] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:28 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:29.243914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:29.245716 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:29.270450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:29.273417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:29.273848 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:29.278263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:29.280086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:29.283565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:29.668143 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:29.679980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:29.681708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:29.683066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4181bfb4-61a3-42e5-88ae-086a40ec502e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1334 microversion: 2.20 time: 0.452788 Sep 24 19:45:29.685474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 50/91] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:29 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1334 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:29.708280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:29.710026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:29.720277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:29.721171 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:29.721891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:29.724440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:29.725466 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:29.726456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:29.772851 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:29.784253 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-278fd47d-d247-4cc5-8ba2-7a73d327163c tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.647365 Sep 24 19:45:29.805704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 42/92] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:29 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:29.871090 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:29.884436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1fd4a86d-5445-4a7b-86c0-357a48eb014c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1296 microversion: 2.1 time: 0.194610 Sep 24 19:45:29.887681 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 51/93] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:29 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1296 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:30.145111 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:30.147311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:30.160752 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.161441 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.163080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.164040 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.168272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.168947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.225414 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:30.261026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:30.263285 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:30.274792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.280114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.280873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.281711 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.284245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.284784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.553609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:30.568190 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5cffea51-ca99-405e-a6ac-3ba1c7dd3cbe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.429645 Sep 24 19:45:30.568774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 43/94] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:30 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:30.699222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:30.714384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8605cc53-be59-4a77-8f0a-8963c7aa3ccb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.458864 Sep 24 19:45:30.715254 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:30.715782 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 52/95] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:30 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:30.716455 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:30.727867 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.728691 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.730793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.732677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.733186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.733861 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.812589 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:30.813801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:30.829095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.829931 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.830579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.831676 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.832349 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.833014 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.841947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:30.861477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:30.863984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:30.865460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d5118355-58ef-4d08-9ae2-c33d7ceae5b6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1340 microversion: 2.20 time: 0.155322 Sep 24 19:45:30.866351 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 44/96] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:30 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1340 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:30.960394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-06f0d6b9-971a-4359-a408-ad8305231291 req-a0c9cf16-1e69-4ff4-bd6d-366600909721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80852886-4e5c-4ecf-acf0-400d0e5dea6e", "tag": "5f6b05eb-7f1c-44bc-b4af-dce3c8a07a70"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:30.975112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-06f0d6b9-971a-4359-a408-ad8305231291 req-a0c9cf16-1e69-4ff4-bd6d-366600909721 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:30.976844 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-06f0d6b9-971a-4359-a408-ad8305231291 req-a0c9cf16-1e69-4ff4-bd6d-366600909721 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:30.977297 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-06f0d6b9-971a-4359-a408-ad8305231291 req-a0c9cf16-1e69-4ff4-bd6d-366600909721 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:30.990503 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-06f0d6b9-971a-4359-a408-ad8305231291 req-a0c9cf16-1e69-4ff4-bd6d-366600909721 service nova] Creating event network-changed:5f6b05eb-7f1c-44bc-b4af-dce3c8a07a70 for instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e on hv-cinder-85919 Sep 24 19:45:30.995956 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-06f0d6b9-971a-4359-a408-ad8305231291 req-a0c9cf16-1e69-4ff4-bd6d-366600909721 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127940 Sep 24 19:45:30.997126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 45/97] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:31.018582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:31.019183 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:31.028928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:31.029451 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:31.029878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:31.031812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:31.032293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:31.032734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:31.252105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:31.261849 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-dd386bd7-984b-4c15-aee1-4e4e87061cd8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.260960 Sep 24 19:45:31.262705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 46/98] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:30 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:31.273345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:31.287185 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-03c886ee-312a-4f1f-a137-ed5e59829d89 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.479012 Sep 24 19:45:31.299903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 53/99] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:30 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:31.595971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:31.597144 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:31.610910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:31.617400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:31.620442 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:31.621830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:31.623301 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:31.624251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:31.624910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:31.739321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:31.739985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:31.750486 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:31.750990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:31.751447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:31.752151 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:31.752605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:31.753032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:32.380387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:32.403227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5d140a0e-c1b8-4277-ade3-ec999867c905 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.667996 Sep 24 19:45:32.404538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 54/100] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:31 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:32.425562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:32.429115 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:32.451328 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:32.458662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:32.462600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:32.468371 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:32.473956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:32.475248 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:32.652146 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:32.673548 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-66bb46b4-94f8-4ab0-8f7a-61c050362afc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 1.075470 Sep 24 19:45:32.674259 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 47/101] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:31 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:32.679702 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:32.683510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:32.709498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:32.710109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:32.714269 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:32.719996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:32.720738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:32.721392 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:32.824522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:32.840896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:32.849386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:32.856738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b0527da4-b51e-46c2-958c-ccb42e5083e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1340 microversion: 2.20 time: 0.449608 Sep 24 19:45:32.862670 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 55/102] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:32 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1340 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:32.879456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:32.880437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:32.891556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:32.891964 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:32.892475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:32.896274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:32.896947 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:32.897511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:33.170407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:33.182268 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d2a6a61e-3491-4a7b-bf06-53bdd9584bbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.317304 Sep 24 19:45:33.194948 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:33.196778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 56/103] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:32 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:33.214696 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c42cb3a1-9dd4-46e8-ad2c-7a6e37bda26f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.538905 Sep 24 19:45:33.215461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 48/104] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:32 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:33.433421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:33.434432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:33.450151 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:33.453493 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:33.455934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:33.456918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:33.459465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:33.460669 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:33.646359 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:33.702119 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:33.703562 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:33.717497 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:33.718465 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:33.719053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:33.720107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:33.720708 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:33.721397 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:33.937195 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:33.948429 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-315f696c-c426-4eb4-9fe1-cd05ff8de185 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.519659 Sep 24 19:45:33.949297 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 57/105] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:33 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:33.972679 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-58bdb3ec-0eb8-4f56-b9e2-97a63c28eb66 req-21fb158b-67f7-428d-b521-4c6052256dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0ca8da-4101-49bb-8747-b834c6555edd", "tag": "f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:33.998179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-58bdb3ec-0eb8-4f56-b9e2-97a63c28eb66 req-21fb158b-67f7-428d-b521-4c6052256dd8 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:34.001093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-58bdb3ec-0eb8-4f56-b9e2-97a63c28eb66 req-21fb158b-67f7-428d-b521-4c6052256dd8 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:34.001825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-58bdb3ec-0eb8-4f56-b9e2-97a63c28eb66 req-21fb158b-67f7-428d-b521-4c6052256dd8 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:34.027860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-58bdb3ec-0eb8-4f56-b9e2-97a63c28eb66 req-21fb158b-67f7-428d-b521-4c6052256dd8 service nova] Creating event network-changed:f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab for instance 9c0ca8da-4101-49bb-8747-b834c6555edd on hv-cinder-85919 Sep 24 19:45:34.048881 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-58bdb3ec-0eb8-4f56-b9e2-97a63c28eb66 req-21fb158b-67f7-428d-b521-4c6052256dd8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084846 Sep 24 19:45:34.052084 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 58/106] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:34.079806 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:34.080657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:34.087661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:34.088162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:34.088607 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:34.089317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:34.089785 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:34.090215 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:34.223233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:34.240331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:34.244198 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:34.249698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-955d003f-7e23-4fc9-bec5-b916fca6a568 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1340 microversion: 2.20 time: 0.191963 Sep 24 19:45:34.263522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 59/107] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:34 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:34.263522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:34.263522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:34.276854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:34.280664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:34.281217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:34.281969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:34.282450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:34.282887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:34.723197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:34.738576 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:34.746176 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-019bbffb-ae0c-4a48-b882-5743bae03f3b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.491742 Sep 24 19:45:34.747928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8028567f-488f-49a6-b66e-d2578d72097a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 1.049611 Sep 24 19:45:34.749428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 49/108] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:33 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:34.752544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 60/109] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:34 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:34.754955 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:34.755825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:34.773775 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:34.774639 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:34.775285 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:34.777647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:34.779775 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:34.781019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.165523 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-ff479402-64c7-4136-8a91-18e517b1e71b req-00e24451-7b00-4c5c-9ecc-b56d58b044fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80229451-4d17-4bee-9b50-a0cc56402c62", "name": "network-vif-plugged", "status": "completed", "tag": "1cf67c9e-a9bb-4997-90fc-1e81d09b909e"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:35.167324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:35.182076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4d339c71-4318-4cf1-a640-47cfdcbd1815 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.431210 Sep 24 19:45:35.185060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 50/110] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:34 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:35.187040 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ff479402-64c7-4136-8a91-18e517b1e71b req-00e24451-7b00-4c5c-9ecc-b56d58b044fb service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.188710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ff479402-64c7-4136-8a91-18e517b1e71b req-00e24451-7b00-4c5c-9ecc-b56d58b044fb service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.190507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ff479402-64c7-4136-8a91-18e517b1e71b req-00e24451-7b00-4c5c-9ecc-b56d58b044fb service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.197470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-56b8fd5b-e641-462f-95ef-3c8f5810d928 req-c409108c-6726-4851-bc74-30e36fd78710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b340b141-ffdd-4b0e-99f4-fd4820056f61", "tag": "e402482a-cd5d-428e-92e9-1fcf957e3f02"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:35.220942 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-ff479402-64c7-4136-8a91-18e517b1e71b req-00e24451-7b00-4c5c-9ecc-b56d58b044fb service nova] Creating event network-vif-plugged:1cf67c9e-a9bb-4997-90fc-1e81d09b909e for instance 80229451-4d17-4bee-9b50-a0cc56402c62 on hv-cinder-85919 Sep 24 19:45:35.235537 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-ff479402-64c7-4136-8a91-18e517b1e71b req-00e24451-7b00-4c5c-9ecc-b56d58b044fb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.480450 Sep 24 19:45:35.236153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-56b8fd5b-e641-462f-95ef-3c8f5810d928 req-c409108c-6726-4851-bc74-30e36fd78710 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.236636 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-56b8fd5b-e641-462f-95ef-3c8f5810d928 req-c409108c-6726-4851-bc74-30e36fd78710 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.237231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-56b8fd5b-e641-462f-95ef-3c8f5810d928 req-c409108c-6726-4851-bc74-30e36fd78710 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.251651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 61/111] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:35.260413 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:35.261634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:35.273727 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-56b8fd5b-e641-462f-95ef-3c8f5810d928 req-c409108c-6726-4851-bc74-30e36fd78710 service nova] Creating event network-changed:e402482a-cd5d-428e-92e9-1fcf957e3f02 for instance b340b141-ffdd-4b0e-99f4-fd4820056f61 on hv-cinder-85919 Sep 24 19:45:35.284956 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-56b8fd5b-e641-462f-95ef-3c8f5810d928 req-c409108c-6726-4851-bc74-30e36fd78710 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092148 Sep 24 19:45:35.285445 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.285977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.286361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 51/112] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:35.286490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.287150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.289210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.290008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.293299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:35.294759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:35.302647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.303553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.304151 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.305015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.305835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.306449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.493938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:35.503470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:35.503840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-05113032-a5c0-409d-ad9e-955e4befb221 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.250600 Sep 24 19:45:35.505119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 62/113] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:35 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:35.518253 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:35.527826 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:35.534257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8978deb2-c50b-4a1d-a8fd-35b3163f02b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.244973 Sep 24 19:45:35.535542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 52/114] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:35 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:35.804363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:35.805042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:35.821994 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.827824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.828600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:35.829424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:35.831835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.836308 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.838432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.838582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.839143 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.839612 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.840276 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:35.841310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:35.846177 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:35.847160 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:36.176986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:36.185149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-74b08cd1-d3aa-4fa9-919e-5f8d4e6fe91d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.394195 Sep 24 19:45:36.191164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 63/115] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:35 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:36.212919 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:36.213735 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:36.224307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:36.224793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:36.228821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:36.229816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:36.230446 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:36.231031 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:36.510360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:36.525372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e9ce59ab-ae17-447d-83f1-5a6029cbd64e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.314319 Sep 24 19:45:36.527469 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 64/116] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:36 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:36.537073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:36.537936 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:36.546200 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:36.546780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:36.547379 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:36.548159 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:36.548640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:36.549275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:36.812420 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:36.816309 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:36.824945 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fbc2e0a1-cc42-4c63-8f8e-30d7dd471975 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.295121 Sep 24 19:45:36.825733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 65/117] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:36 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:36.835979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:36.837336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:36.849238 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:36.849781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:36.850263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:36.851016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:36.851562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:36.852059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:37.053111 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:37.074249 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:37.075978 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:37.079135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d72a0462-176f-498b-a699-1eadb3b4e92c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.251998 Sep 24 19:45:37.079944 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 66/118] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:36 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:37.141790 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:37.153790 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-031b3aac-4098-463e-826d-ca14182ec9a3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 1.361616 Sep 24 19:45:37.155595 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 53/119] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:35 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:37.215264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:37.216408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:37.224995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:37.228744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:37.229312 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:37.230143 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:37.232651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:37.234017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:37.255993 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-c40c393f-14d4-4e62-bdc2-10084ab75f14 req-6bea8adf-e81e-4522-a6ab-398cb02d224e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc80c86-d224-4d77-9985-9658a8c0a47b", "name": "network-vif-plugged", "status": "completed", "tag": "c1ba06bb-5a83-4d65-b2c1-1ee23f4fb7dd"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:37.277003 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-c40c393f-14d4-4e62-bdc2-10084ab75f14 req-6bea8adf-e81e-4522-a6ab-398cb02d224e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:37.278706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-c40c393f-14d4-4e62-bdc2-10084ab75f14 req-6bea8adf-e81e-4522-a6ab-398cb02d224e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:37.280852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-c40c393f-14d4-4e62-bdc2-10084ab75f14 req-6bea8adf-e81e-4522-a6ab-398cb02d224e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:37.312858 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-c40c393f-14d4-4e62-bdc2-10084ab75f14 req-6bea8adf-e81e-4522-a6ab-398cb02d224e service nova] Creating event network-vif-plugged:c1ba06bb-5a83-4d65-b2c1-1ee23f4fb7dd for instance afc80c86-d224-4d77-9985-9658a8c0a47b on hv-cinder-85919 Sep 24 19:45:37.319607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-c40c393f-14d4-4e62-bdc2-10084ab75f14 req-6bea8adf-e81e-4522-a6ab-398cb02d224e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068016 Sep 24 19:45:37.332025 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 54/120] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:45:37.552494 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:37.554460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:37.582993 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:37.595381 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:37.596969 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:37.601917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:37.605157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:37.609336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:37.666040 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:37.675409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-67a3ed1f-8084-4220-88e6-318b6db4b986 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.464600 Sep 24 19:45:37.699926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 67/121] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:37 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:37.849417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:37.850754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:37.854247 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:37.867158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:37.868408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:37.870375 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:37.872854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:37.875553 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:37.876375 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.190637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:38.200088 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d29b6e08-9aa7-49fc-8148-5ad02034e93a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.355470 Sep 24 19:45:38.212073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 68/122] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:37 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:38.239939 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:38.240744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:38.254375 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:38.256693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:38.261907 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:38.262733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.262961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1dce594a-dd2f-4ad0-aad6-329583d96fdb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.716949 Sep 24 19:45:38.263564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 55/123] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:37 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:38.265103 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:38.266832 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:38.267541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.279836 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:38.280514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:38.292284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:38.296327 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:38.296894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.299674 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:38.300232 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:38.300733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.485962 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:38.495586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:38.497418 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:38.499191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a088bd4d-5201-4211-bd6a-9b751701e12b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.278302 Sep 24 19:45:38.501192 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 69/124] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:38 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:38.681887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-6dd7a7b5-58d6-4049-bf74-bdce9551036a req-0d896369-21a2-4c18-84c1-b04a2b6ed5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff567a7-861e-469a-913d-add40f3220c9", "tag": "8874d4a7-638a-44b3-b521-fda12ba4f441"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:38.696713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:38.729739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-613674f3-16bb-494d-84fc-505422750607 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.465110 Sep 24 19:45:38.732759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-6dd7a7b5-58d6-4049-bf74-bdce9551036a req-0d896369-21a2-4c18-84c1-b04a2b6ed5c6 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:38.733792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-6dd7a7b5-58d6-4049-bf74-bdce9551036a req-0d896369-21a2-4c18-84c1-b04a2b6ed5c6 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:38.735116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-6dd7a7b5-58d6-4049-bf74-bdce9551036a req-0d896369-21a2-4c18-84c1-b04a2b6ed5c6 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.737985 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 56/125] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:38 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:38.746897 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:38.750869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-6dd7a7b5-58d6-4049-bf74-bdce9551036a req-0d896369-21a2-4c18-84c1-b04a2b6ed5c6 service nova] Creating event network-changed:8874d4a7-638a-44b3-b521-fda12ba4f441 for instance bff567a7-861e-469a-913d-add40f3220c9 on hv-cinder-85919 Sep 24 19:45:38.755764 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:38.756868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-6dd7a7b5-58d6-4049-bf74-bdce9551036a req-0d896369-21a2-4c18-84c1-b04a2b6ed5c6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080432 Sep 24 19:45:38.757764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 70/126] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:45:38.765437 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:38.766021 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:38.766525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.767227 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:38.767780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:38.768207 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:38.907932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:38.915738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7b5f5d6c-f2c3-48f8-960f-80a615b2c49f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.176500 Sep 24 19:45:38.916307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 57/127] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:38 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:39.243142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:39.245669 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:39.263926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.265308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.265989 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.266835 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.267302 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.267759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.288489 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:39.289102 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:39.299658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.300152 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.300819 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.301524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.301975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.302557 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.570844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:39.579750 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b4294aff-4fd2-4d6c-974a-d5a5b102c016 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.347534 Sep 24 19:45:39.580655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 71/128] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:39 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:39.585925 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:39.586543 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:39.593452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.594253 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.594904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.595876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.596343 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.596775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.646802 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:39.654541 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5ac0d6ac-322f-46ae-a177-0ea03d67147d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.369765 Sep 24 19:45:39.668368 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 58/129] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:39 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:39.761232 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:39.762312 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:39.770100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.770597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.770729 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:39.771034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.787705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:39.788144 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.788878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.789297 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:39.789449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.790672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5fd13179-7ab4-4bc0-9f08-82a46b706864 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.208855 Sep 24 19:45:39.791675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 72/130] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:39 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:39.941304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:39.942550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:39.949931 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.950447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.950863 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.951624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:39.952970 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:39.953417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:39.981801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:39.990562 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-428205f8-c494-4a3b-8418-3c207cf78c4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1367 microversion: 2.1 time: 0.234347 Sep 24 19:45:39.992720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 59/131] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:39 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:40.103189 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:40.118956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6a536d82-9dd9-4070-ad25-064913622016 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.181531 Sep 24 19:45:40.128338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 73/132] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:39 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:40.602217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:40.602894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:40.609893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:40.610388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:40.610823 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:40.611568 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:40.612026 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:40.612448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:40.682468 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:40.685069 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:40.696490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:40.698018 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:40.698864 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:40.700384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:40.701067 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:40.702099 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:40.777477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:40.790160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-16ab7cea-0bf5-4599-bd11-9bf7f45afe38 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.191609 Sep 24 19:45:40.791112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 60/133] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:40 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:40.824017 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:40.825020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:40.837830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:40.838546 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:40.839049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:40.840464 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:40.841341 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:40.841778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:40.977642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:40.986973 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-74597905-13f2-49cd-8718-8cf62772568e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.312845 Sep 24 19:45:40.991458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 74/134] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:40 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:41.031826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-b123e4a4-0e78-43f8-818c-64d317762833 req-ce0b15c1-5ea4-49f3-ba3d-b8880a754f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80852886-4e5c-4ecf-acf0-400d0e5dea6e", "name": "network-vif-plugged", "status": "completed", "tag": "5f6b05eb-7f1c-44bc-b4af-dce3c8a07a70"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:41.046934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b123e4a4-0e78-43f8-818c-64d317762833 req-ce0b15c1-5ea4-49f3-ba3d-b8880a754f4b service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.047977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b123e4a4-0e78-43f8-818c-64d317762833 req-ce0b15c1-5ea4-49f3-ba3d-b8880a754f4b service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.071091 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b123e4a4-0e78-43f8-818c-64d317762833 req-ce0b15c1-5ea4-49f3-ba3d-b8880a754f4b service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.080136 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-b123e4a4-0e78-43f8-818c-64d317762833 req-ce0b15c1-5ea4-49f3-ba3d-b8880a754f4b service nova] Creating event network-vif-plugged:5f6b05eb-7f1c-44bc-b4af-dce3c8a07a70 for instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e on hv-cinder-85919 Sep 24 19:45:41.085119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-b123e4a4-0e78-43f8-818c-64d317762833 req-ce0b15c1-5ea4-49f3-ba3d-b8880a754f4b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077099 Sep 24 19:45:41.085883 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 75/135] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:41.091758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:41.092550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:41.098756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.099253 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.099751 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.100466 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.100931 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.101364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.110384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:41.118189 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:41.122664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:41.125266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:41.126535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-67c41547-8033-41b7-a761-5bb10330fff1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.308095 Sep 24 19:45:41.140227 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 61/136] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:40 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:41.145666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:41.146293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:41.153634 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.155318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.156091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.156853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.157366 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.157807 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.262693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:41.271216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4469273c-fb6f-4098-916a-ec31ed9fc776 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1557 microversion: 2.1 time: 0.183877 Sep 24 19:45:41.283728 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 76/137] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:41 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:41.294723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:41.296108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:41.302392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.302882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.303555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.304485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.305105 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.305539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.314219 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:41.328786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9988187c-f044-4b9c-9ee0-84861c1190d0 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.186905 Sep 24 19:45:41.329671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 62/138] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:41 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:41.426652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5fbac253-3f34-4ecb-b731-db5f063f8538 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135588 Sep 24 19:45:41.427317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 77/139] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:45:41 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:45:41.816224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:41.816847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:41.823113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.823644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.824089 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.824988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:41.825454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:41.825892 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:41.974007 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:41.981919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5b428b2a-cef9-4c00-8e4e-dc463161b302 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.169812 Sep 24 19:45:41.983720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 63/140] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:41 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:42.015562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:42.016835 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:42.023043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:42.023833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:42.024459 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:42.025382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:42.026026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:42.026634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:42.153141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:42.154075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:42.161447 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:42.161944 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:42.163202 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:42.164086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:42.164616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:42.164991 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:42.285193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:42.296836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a9c5ad3a-56df-4a33-ac55-bc5d4f139bd7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.284560 Sep 24 19:45:42.298767 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 78/141] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:42 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:42.352690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:42.354001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:42.377481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:42.384076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:42.385110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:42.388323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:42.389005 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:42.390937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:42.607614 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:42.626685 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:42.628883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:42.633006 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9a4da4e8-1501-45a0-945d-5b61c473e630 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.484845 Sep 24 19:45:42.644011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 64/142] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:42 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:45:42.841496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:42.860705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-77186b91-6c7c-48ad-afb4-f9b9d9bd3c0e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.511122 Sep 24 19:45:42.873074 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 79/143] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:42 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:43.013462 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:43.014302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:43.022970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.023854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.024506 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.025404 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.026159 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.026868 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.108716 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-967ab628-843d-4bb3-b0bd-f50ca5f91f66 req-ae508ca5-139b-4693-bd80-d1249e280a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0ca8da-4101-49bb-8747-b834c6555edd", "name": "network-vif-plugged", "status": "completed", "tag": "f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:43.132880 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-967ab628-843d-4bb3-b0bd-f50ca5f91f66 req-ae508ca5-139b-4693-bd80-d1249e280a31 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.134655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-967ab628-843d-4bb3-b0bd-f50ca5f91f66 req-ae508ca5-139b-4693-bd80-d1249e280a31 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.135358 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-967ab628-843d-4bb3-b0bd-f50ca5f91f66 req-ae508ca5-139b-4693-bd80-d1249e280a31 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.154478 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-967ab628-843d-4bb3-b0bd-f50ca5f91f66 req-ae508ca5-139b-4693-bd80-d1249e280a31 service nova] Creating event network-vif-plugged:f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab for instance 9c0ca8da-4101-49bb-8747-b834c6555edd on hv-cinder-85919 Sep 24 19:45:43.164464 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-967ab628-843d-4bb3-b0bd-f50ca5f91f66 req-ae508ca5-139b-4693-bd80-d1249e280a31 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061737 Sep 24 19:45:43.166347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 80/144] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:45:43.254548 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:43.263494 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bb17b3cf-5bc9-4405-bb36-3ac10f358bf0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.262660 Sep 24 19:45:43.264130 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 65/145] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:42 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:43.324882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:43.325100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:43.333357 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.334111 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.334787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.335613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.336299 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.336839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.653425 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:43.666807 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f6e56bd7-1c6f-42d1-a1c6-0120d0e3e6f3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.346639 Sep 24 19:45:43.675465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 81/146] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:43 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:43.683652 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:43.684034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-525c9ef7-88fa-4e83-acdc-154e4d1e2a01 req-441e8294-402c-45ca-a14a-572a555fb795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80229451-4d17-4bee-9b50-a0cc56402c62", "tag": "1cf67c9e-a9bb-4997-90fc-1e81d09b909e"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:43.684121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:43.690135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.690984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.691587 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.692941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.693564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.694140 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.705807 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-525c9ef7-88fa-4e83-acdc-154e4d1e2a01 req-441e8294-402c-45ca-a14a-572a555fb795 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.707367 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-525c9ef7-88fa-4e83-acdc-154e4d1e2a01 req-441e8294-402c-45ca-a14a-572a555fb795 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.707844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-525c9ef7-88fa-4e83-acdc-154e4d1e2a01 req-441e8294-402c-45ca-a14a-572a555fb795 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.737024 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-525c9ef7-88fa-4e83-acdc-154e4d1e2a01 req-441e8294-402c-45ca-a14a-572a555fb795 service nova] Creating event network-changed:1cf67c9e-a9bb-4997-90fc-1e81d09b909e for instance 80229451-4d17-4bee-9b50-a0cc56402c62 on hv-cinder-85919 Sep 24 19:45:43.749216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-525c9ef7-88fa-4e83-acdc-154e4d1e2a01 req-441e8294-402c-45ca-a14a-572a555fb795 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080114 Sep 24 19:45:43.750135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 82/147] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:45:43.886653 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:43.896293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:43.903845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.904903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.905827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:43.906722 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:43.907336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:43.907934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:44.208175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:44.238291 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1fa363d6-4f09-49d3-a7ae-323626137cbc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.354140 Sep 24 19:45:44.244741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 83/148] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:43 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:44.290197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:44.290923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:44.298983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:44.300061 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:44.300768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:44.301765 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:44.302443 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:44.303156 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:44.353698 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:44.372338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:44.377188 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:44.378578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-482a43ac-5484-4848-b97c-cf264418b820 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.720177 Sep 24 19:45:44.384896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 66/149] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:43 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:45:44.692672 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:44.693306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:44.704014 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:44.704512 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:44.712361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:44.714358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:44.715710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:44.716274 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:44.821133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:44.836781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ee825b64-1a14-4db3-8045-0ee7958c09d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.551031 Sep 24 19:45:44.852248 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 84/150] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:44 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:44.995997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:45.007119 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5fa6886a-21a7-4c82-b7b8-ed1d94fa5c12 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.318231 Sep 24 19:45:45.025433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 67/151] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:44 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:45.189910 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-392e599c-2e01-471c-a387-365d63bca4ff req-ee68df08-cb1c-458b-b449-fd8d3a97cc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b340b141-ffdd-4b0e-99f4-fd4820056f61", "name": "network-vif-plugged", "status": "completed", "tag": "e402482a-cd5d-428e-92e9-1fcf957e3f02"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:45.205166 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-392e599c-2e01-471c-a387-365d63bca4ff req-ee68df08-cb1c-458b-b449-fd8d3a97cc05 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:45.206192 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-392e599c-2e01-471c-a387-365d63bca4ff req-ee68df08-cb1c-458b-b449-fd8d3a97cc05 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:45.207568 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-392e599c-2e01-471c-a387-365d63bca4ff req-ee68df08-cb1c-458b-b449-fd8d3a97cc05 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:45.221686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-392e599c-2e01-471c-a387-365d63bca4ff req-ee68df08-cb1c-458b-b449-fd8d3a97cc05 service nova] Creating event network-vif-plugged:e402482a-cd5d-428e-92e9-1fcf957e3f02 for instance b340b141-ffdd-4b0e-99f4-fd4820056f61 on hv-cinder-85919 Sep 24 19:45:45.228566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-392e599c-2e01-471c-a387-365d63bca4ff req-ee68df08-cb1c-458b-b449-fd8d3a97cc05 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042500 Sep 24 19:45:45.229799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 85/152] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:45.275082 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:45.275734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:45.286112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:45.286857 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:45.287493 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:45.288513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:45.289119 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:45.289712 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:45.408552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:45.409331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:45.419258 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:45.420036 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:45.420554 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:45.421251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:45.421704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:45.422127 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:45.432033 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:45.476757 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:45.495034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-415dd728-6bc6-4f8a-b9bf-c9c003ae1a0f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1314 microversion: 2.1 time: 0.227584 Sep 24 19:45:45.507471 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 68/153] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:45 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:45.646862 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:45.660035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:45.661958 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:45.662993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ea0f5ee7-0d22-446a-b235-20907bf8bb9e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.262888 Sep 24 19:45:45.675804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 86/154] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:45 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:45:45.862119 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:45.863213 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:45.871679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:45.872180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:45.872684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:45.873361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:45.873878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:45.874382 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:46.034283 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:46.035110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:46.045532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:46.046316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:46.051571 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:46.052971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:46.053471 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:46.054520 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:46.187238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:46.197780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-86ff9cdf-38e2-4211-9a47-1f75044965ad tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.340716 Sep 24 19:45:46.198354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 69/155] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:45 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:46.333760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:46.345221 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-35163413-8b1d-4979-8319-bf2b9fc660b5 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1363 microversion: 2.1 time: 0.315624 Sep 24 19:45:46.345822 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 87/156] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:46 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:46.524578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:46.527270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:46.540520 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:46.541033 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:46.541481 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:46.542196 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:46.542664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:46.549787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:46.691618 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:46.692517 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:46.710453 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:46.710962 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:46.711408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:46.712140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:46.713921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:46.716319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:46.939267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:46.953322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-faac8872-a1bc-4296-afd4-c53fa371a39f tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1501 microversion: 2.1 time: 0.432579 Sep 24 19:45:46.956684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 70/157] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:46 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1501 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:47.032233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:47.043180 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:47.050652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:47.052987 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-480f6939-bf4f-468a-b530-8021eca662c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.366801 Sep 24 19:45:47.055822 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 88/158] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:46 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:47.228263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:47.229336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:47.237001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:47.239224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:47.240296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:47.253847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:47.254655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:47.255147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:47.370014 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:47.370828 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:47.381605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:47.382396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:47.382979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:47.384074 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:47.384535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:47.385409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:47.590731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:47.603546 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b33b7c12-cbba-47f0-8885-b21d82400902 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.384093 Sep 24 19:45:47.606691 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 71/159] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:47 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:47.698949 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:47.714859 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-26811e13-a3b8-458f-a783-27b03fb5d134 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1550 microversion: 2.1 time: 0.348325 Sep 24 19:45:47.727454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 89/160] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:47 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1550 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:47.743666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:47.744645 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:47.756140 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:47.756833 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:47.757483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:47.758405 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:47.759665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:47.761337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:47.908766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ff5b8e07-2551-4ed0-8cb8-916dab34df8f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170813 Sep 24 19:45:47.909351 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 72/161] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:45:47 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:48.100720 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:48.106598 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:48.114057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:48.114816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:48.115408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:48.116498 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:48.117111 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:48.117697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:48.238292 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-a707815e-55ed-44b8-98b3-ca06316b8197 req-c6e0ed3f-142d-4eb6-a2af-a472db89fac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff567a7-861e-469a-913d-add40f3220c9", "name": "network-vif-plugged", "status": "completed", "tag": "8874d4a7-638a-44b3-b521-fda12ba4f441"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:48.244687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:48.252458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a707815e-55ed-44b8-98b3-ca06316b8197 req-c6e0ed3f-142d-4eb6-a2af-a472db89fac6 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:48.252458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a707815e-55ed-44b8-98b3-ca06316b8197 req-c6e0ed3f-142d-4eb6-a2af-a472db89fac6 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:48.252458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a707815e-55ed-44b8-98b3-ca06316b8197 req-c6e0ed3f-142d-4eb6-a2af-a472db89fac6 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:48.265346 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-a707815e-55ed-44b8-98b3-ca06316b8197 req-c6e0ed3f-142d-4eb6-a2af-a472db89fac6 service nova] Creating event network-vif-plugged:8874d4a7-638a-44b3-b521-fda12ba4f441 for instance bff567a7-861e-469a-913d-add40f3220c9 on hv-cinder-85919 Sep 24 19:45:48.277135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-a707815e-55ed-44b8-98b3-ca06316b8197 req-c6e0ed3f-142d-4eb6-a2af-a472db89fac6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042543 Sep 24 19:45:48.278456 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 73/162] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:48.492090 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:48.501065 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:48.503048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:48.504616 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1a30bec7-087f-4342-9845-16e1868e879d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.416919 Sep 24 19:45:48.505316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 90/163] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:48 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:48.634859 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:48.637724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:48.648625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:48.649114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:48.649890 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:48.650783 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:48.651246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:48.651698 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:48.673424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5c44530-eade-47dc-9be8-02b43964c58e"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:48.676110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:48.691977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:48.692526 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:48.692965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:48.693871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:48.695466 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:48.695884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:48.929195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:48.956887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-237d721f-3dec-42c9-b04f-6a70c58c81a0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1321 microversion: 2.1 time: 0.329128 Sep 24 19:45:48.971306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 74/164] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:48 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:49.432262 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-cfc9fc9e-4610-4c5d-a3dd-63aff57f5555 req-88922df0-a03e-47c0-9148-1b027671abb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c0ca8da-4101-49bb-8747-b834c6555edd", "tag": "f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:49.444387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-cfc9fc9e-4610-4c5d-a3dd-63aff57f5555 req-88922df0-a03e-47c0-9148-1b027671abb0 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:49.445337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-cfc9fc9e-4610-4c5d-a3dd-63aff57f5555 req-88922df0-a03e-47c0-9148-1b027671abb0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:49.446109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-cfc9fc9e-4610-4c5d-a3dd-63aff57f5555 req-88922df0-a03e-47c0-9148-1b027671abb0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:49.463555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-cfc9fc9e-4610-4c5d-a3dd-63aff57f5555 req-88922df0-a03e-47c0-9148-1b027671abb0 service nova] Creating event network-changed:f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab for instance 9c0ca8da-4101-49bb-8747-b834c6555edd on hv-cinder-85919 Sep 24 19:45:49.470697 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-cfc9fc9e-4610-4c5d-a3dd-63aff57f5555 req-88922df0-a03e-47c0-9148-1b027671abb0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042543 Sep 24 19:45:49.472499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 75/165] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:49.531485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:49.532335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:49.538849 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:49.539569 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:49.540186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:49.541043 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:49.541649 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:49.542346 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:49.695386 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:49.704510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:49.706414 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:49.710780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6213a234-98cd-44ca-a70e-161e8fff259a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.183915 Sep 24 19:45:49.720073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 76/166] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:49 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:49.982596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:49.983633 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:49.991319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:49.991995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:49.992716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:49.993644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:49.994316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:49.995164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:50.097480 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6528be02-a491-4ecc-b9ce-522b43d6551b tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "POST /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.430904 Sep 24 19:45:50.103854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 91/167] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:45:48 2022] POST /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e/os-volume_attachments => generated 194 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:45:50.209244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:50.224806 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1b3005a3-cc7e-4b4e-8f38-daea0c4a9d71 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1514 microversion: 2.1 time: 0.246258 Sep 24 19:45:50.226168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 77/168] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:49 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:45:50.250937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:50.255293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:50.263195 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:50.263756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:50.264451 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:50.265168 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:50.265827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:50.266261 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:50.296142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lazy-loading 'flavor' on Instance uuid b340b141-ffdd-4b0e-99f4-fd4820056f61 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:45:50.457949 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-edf07611-0e2b-4766-8b78-1a5ac12f66f1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61/action" status: 200 len: 32 microversion: 2.1 time: 0.211841 Sep 24 19:45:50.458570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 92/169] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:45:50 2022] POST /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:45:50.472672 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:50.474168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:50.486101 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:50.486594 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:50.487034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:50.487786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:50.488248 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:50.488671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:50.686086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:50.695992 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-28921bce-8b80-4fe3-b698-e41ceefb222a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.230675 Sep 24 19:45:50.696764 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 78/170] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:50 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:50.739554 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:50.741017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:50.749125 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:50.749627 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:50.750077 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:50.750795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:50.751261 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:50.751744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:51.023831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:51.032492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:51.034213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:51.035785 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7936190d-0b8b-4835-81fc-530af10530b5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1408 microversion: 2.20 time: 0.300675 Sep 24 19:45:51.036987 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 93/171] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:50 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:51.718461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:51.719008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:51.725118 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:51.725598 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:51.726026 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:51.726778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:51.727234 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:51.727693 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:51.919477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:51.928548 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-69bd445e-89a1-4069-bd66-335a74b93b17 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.214025 Sep 24 19:45:51.929122 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 79/172] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:51 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:52.061500 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:52.062118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:52.069131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:52.069836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:52.070804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:52.071742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:52.072380 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:52.078459 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:52.500629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:52.509058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:52.510530 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:52.511787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-72116154-4d2f-4695-934c-53e9e4e15f2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1600 microversion: 2.20 time: 0.454575 Sep 24 19:45:52.512338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 94/173] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:45:52 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1600 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:45:52.537990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:52.538393 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:52.544320 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:52.545169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:52.545803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:52.546501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:52.546958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:52.547379 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:52.551564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:45:52.652842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a271bd32-32b4-40a3-b899-cfc55d4d1c7d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.118781 Sep 24 19:45:52.653515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 80/174] 10.222.0.55 () {60 vars in 1316 bytes} [Sat Sep 24 19:45:52 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:45:52.952767 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:52.954123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:52.963295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:52.964541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:52.965217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:52.966369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:52.967076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:52.971318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:53.193132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:53.202844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f1c6d77c-bd15-483e-b9fb-cda2a3ad3775 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.254818 Sep 24 19:45:53.212939 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 95/175] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:52 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:54.230826 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:54.231485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:54.242850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:54.242850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:54.243042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:54.243780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:54.244248 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:54.244679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:54.291199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-e0bd33c7-02fd-4406-9db2-1076e820fc01 req-9a7f9b0e-f8ff-4233-910d-a7fc76c75406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff567a7-861e-469a-913d-add40f3220c9", "tag": "8874d4a7-638a-44b3-b521-fda12ba4f441"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:45:54.301217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e0bd33c7-02fd-4406-9db2-1076e820fc01 req-9a7f9b0e-f8ff-4233-910d-a7fc76c75406 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:54.301701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e0bd33c7-02fd-4406-9db2-1076e820fc01 req-9a7f9b0e-f8ff-4233-910d-a7fc76c75406 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:54.302134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e0bd33c7-02fd-4406-9db2-1076e820fc01 req-9a7f9b0e-f8ff-4233-910d-a7fc76c75406 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:54.323467 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-e0bd33c7-02fd-4406-9db2-1076e820fc01 req-9a7f9b0e-f8ff-4233-910d-a7fc76c75406 service nova] Creating event network-changed:8874d4a7-638a-44b3-b521-fda12ba4f441 for instance bff567a7-861e-469a-913d-add40f3220c9 on hv-cinder-85919 Sep 24 19:45:54.331819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-e0bd33c7-02fd-4406-9db2-1076e820fc01 req-9a7f9b0e-f8ff-4233-910d-a7fc76c75406 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044735 Sep 24 19:45:54.332432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 96/176] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:45:54.506161 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:54.515892 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b9a939cc-f4c5-4fa3-865b-eb02512df04a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.290013 Sep 24 19:45:54.516824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 81/177] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:54 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:55.539726 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:55.540440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:55.547228 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:55.547747 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:55.548195 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:55.548899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:55.549367 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:55.549800 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:55.692585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:55.700757 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ebc2ea58-d0fc-43e3-80f1-abff25567d59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.165762 Sep 24 19:45:55.702104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 97/178] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:55 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:56.726218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:56.726847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:56.733416 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:56.734423 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:56.734846 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:56.735589 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:56.736053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:56.736495 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:56.926537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:56.934849 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-89b92687-d685-4f60-952c-1c1cdfc758a3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.213140 Sep 24 19:45:56.935519 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 82/179] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:56 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:57.957518 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:57.958137 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:57.965013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:57.965551 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:57.966000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:57.967356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:57.968155 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:57.968593 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:58.111059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:58.118831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-74438512-586a-4004-b08d-e8e12b6eed3a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.165115 Sep 24 19:45:58.119504 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 98/180] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:57 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:45:59.145141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:45:59.146144 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:45:59.156157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:59.156658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:59.157096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:59.157811 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:45:59.158266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:45:59.158694 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:45:59.499879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:45:59.507536 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-474d1558-723c-4ff3-acf3-065e475c2d68 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.369166 Sep 24 19:45:59.508089 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 83/181] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:45:59 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:00.531517 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:00.532134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:00.541644 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:00.542132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:00.542570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:00.543267 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:00.543753 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:00.544177 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:00.700032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:00.712116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-520e07ae-304b-4f9f-9ebc-fcdae57c9f98 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.185885 Sep 24 19:46:00.719455 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 99/182] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:00 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:01.738597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:01.739246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:01.745786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:01.746333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:01.746801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:01.747850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:01.748525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:01.748929 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:01.888258 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:01.896686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-45f9b7ee-b676-4ba4-9b76-cba5e68b6107 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.163362 Sep 24 19:46:01.897248 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 84/183] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:01 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:02.197997 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:02.198518 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:02.205700 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:02.206184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:02.206654 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:02.207358 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:02.207841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:02.208266 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:02.212498 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:02.237436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:46:02.330798 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-65fbfe99-03af-4d96-957c-9280780ff1bc tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 204 len: 0 microversion: 2.1 time: 0.136362 Sep 24 19:46:02.331286 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 100/184] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:46:02 2022] DELETE /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:46:02.339384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:02.340018 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:02.345935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:02.346423 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:02.346868 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:02.347594 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:02.348055 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:02.348485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:02.491249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:02.500297 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6dbe9477-ed67-4f14-a2db-b9ab49650a0d tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1553 microversion: 2.1 time: 0.164693 Sep 24 19:46:02.500867 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 85/185] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:02 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:02.921064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:02.921860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:02.928606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:02.929135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:02.929610 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:02.930350 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:02.930923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:02.931594 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:03.072011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:03.081905 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a477c764-7bcf-4500-b46c-4ea06e78a102 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.165485 Sep 24 19:46:03.082640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 101/186] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:02 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:03.523624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:03.524240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:03.530651 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:03.531138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:03.531613 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:03.532442 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:03.532902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:03.533330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:03.666049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:03.675338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e5849a1e-3f0d-4bf5-81e6-cbc4fb7c4208 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1553 microversion: 2.1 time: 0.155636 Sep 24 19:46:03.675940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 86/187] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:03 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:04.108715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:04.109335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:04.115842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:04.116332 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:04.116774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:04.117475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:04.117938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:04.118363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:04.254004 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:04.265887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-607ed658-05f0-4317-b8ad-458943c67638 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.161590 Sep 24 19:46:04.266497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 102/188] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:04 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:04.698360 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:04.699138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:04.705375 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:04.705910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:04.706369 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:04.707065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:04.707617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:04.708084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:04.840774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:04.849699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-41af8bbb-ac78-45a0-85ce-1f2e4121e7b1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1553 microversion: 2.1 time: 0.155184 Sep 24 19:46:04.850257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 87/189] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:04 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:05.288241 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:05.290462 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:05.295586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:05.296017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:05.296456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:05.297162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:05.297623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:05.298053 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:05.430322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:05.439138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c4e526ec-c0ed-46cd-bfb2-2d02810d4a15 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.154895 Sep 24 19:46:05.439763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 103/190] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:05 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:05.873916 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:05.874535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:05.880579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:05.881058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:05.881490 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:05.882178 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:05.882627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:05.883052 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:06.011037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:06.020000 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9219bf62-696c-4573-97ab-2c881f9eaf06 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1553 microversion: 2.1 time: 0.150583 Sep 24 19:46:06.020567 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 88/191] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:05 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:06.462495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:06.463195 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:06.470462 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:06.471027 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:06.471585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:06.472391 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:06.472934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:06.473377 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:06.604715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:06.613706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8652b7d8-3e8a-4a7d-a38e-df82a2711946 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.155375 Sep 24 19:46:06.614526 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 104/192] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:06 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:07.045876 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:07.046478 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:07.052379 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:07.052864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:07.053299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:07.053978 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:07.054439 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:07.054863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:07.190396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:07.198953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b4be9a4f-119e-41ae-9523-c9e5cbf4b0fd tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1553 microversion: 2.1 time: 0.157308 Sep 24 19:46:07.199564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 89/193] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:07 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:07.637178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:07.637794 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:07.644774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:07.645319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:07.645715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:07.646420 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:07.646883 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:07.647316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:07.804648 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:07.814505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7e9a2d33-8513-48aa-92af-3842805b8d61 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.180840 Sep 24 19:46:07.815566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 105/194] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:07 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:08.222331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:08.222862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:08.228995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:08.229481 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:08.229923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:08.230611 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:08.231064 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:08.231527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:08.364128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:08.373301 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5a4f86e5-8426-4186-9a81-aa1a70db6610 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1553 microversion: 2.1 time: 0.154305 Sep 24 19:46:08.373872 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 90/195] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:08 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:08.840304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:08.841845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:08.844233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:08.860713 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:08.861207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:08.863692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:08.865620 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:08.866097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:08.871698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:09.072789 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:09.081096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-31636db2-c4bd-430d-88b1-051d88994167 req-5a3e284c-9672-4c26-b727-0efb5a6a636e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80852886-4e5c-4ecf-acf0-400d0e5dea6e", "name": "network-vif-deleted", "tag": "5f6b05eb-7f1c-44bc-b4af-dce3c8a07a70"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:09.086799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e95d7280-221b-4fb2-a33c-79329f5fd585 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.252291 Sep 24 19:46:09.087738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 106/196] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:08 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:09.101103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-31636db2-c4bd-430d-88b1-051d88994167 req-5a3e284c-9672-4c26-b727-0efb5a6a636e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:09.101621 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-31636db2-c4bd-430d-88b1-051d88994167 req-5a3e284c-9672-4c26-b727-0efb5a6a636e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:09.102263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-31636db2-c4bd-430d-88b1-051d88994167 req-5a3e284c-9672-4c26-b727-0efb5a6a636e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:09.115419 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-31636db2-c4bd-430d-88b1-051d88994167 req-5a3e284c-9672-4c26-b727-0efb5a6a636e service nova] Creating event network-vif-deleted:5f6b05eb-7f1c-44bc-b4af-dce3c8a07a70 for instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e on hv-cinder-85919 Sep 24 19:46:09.120865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-31636db2-c4bd-430d-88b1-051d88994167 req-5a3e284c-9672-4c26-b727-0efb5a6a636e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063660 Sep 24 19:46:09.121808 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 91/197] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:46:09.397089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:09.397089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:09.403615 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:09.404963 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:09.405433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:09.406127 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:09.406612 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:09.407032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:09.476791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:09.485387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-08e9cdde-b907-4b16-a317-7d41fac63a71 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1345 microversion: 2.1 time: 0.092916 Sep 24 19:46:09.486069 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 107/198] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:09 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:10.111901 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:10.112617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:10.118970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:10.119499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:10.119955 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:10.120790 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:10.121278 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:10.121720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:10.280801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:10.292141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b4bbdb8c-04ce-4faf-8557-d4c0d843058f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.185656 Sep 24 19:46:10.292718 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 92/199] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:10 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:10.508184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:10.509167 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:10.515791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:10.516283 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:10.516997 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:10.517706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:10.518171 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:10.518644 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:10.552255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:10.552756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:10.553193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:10.553646 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lazy-loading 'fault' on Instance uuid 80852886-4e5c-4ecf-acf0-400d0e5dea6e {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:46:10.600447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89b20ec0ede5470eaa33e1ea934991d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0900418261fc4370bbf30ffcc668c4c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:10.610022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-acef58ff-41b4-4792-b8d0-5bf8f6953ff5 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 200 len: 1350 microversion: 2.1 time: 0.105521 Sep 24 19:46:10.610618 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 108/200] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:10 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:11.318703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:11.319440 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:11.325612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:11.327025 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:11.327344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:11.328248 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:11.331515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:11.331992 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:11.492267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:11.501498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4a0de312-3439-4588-8b4d-80746b7cfa26 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.187618 Sep 24 19:46:11.502073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 93/201] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:11 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:11.633763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:11.634437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:11.641606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:11.642096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:11.642532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:11.643236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:11.643732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:11.644156 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:11.658682 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] HTTP exception thrown: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Request method failure captured: Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e HTTP/1.1 Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL14_HKqvEvgDoAt79980Wr6ihGHUbztLEATczneWcm4AwNNnoZSIFNGjAmoWi1KF7cj21O8S9aGzrewDTdVMPCaCSJIjBiKx429ON5SxIRU9BqKJAFu3s3zZNQfoPw8Hx-iVv5v2yA5QOcwsVEdoD43r9sBMCaon13IAhAkK2h5uNLw Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:46:11.663356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 89b20ec0ede5470eaa33e1ea934991d9 Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.665121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '80852886-4e5c-4ecf-acf0-400d0e5dea6e'} Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:46:11.666421 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.668736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.672205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Returning 404 to user: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:46:11.672205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ce5fe3df-90cb-44e2-bcd7-728e481b301e tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 404 len: 111 microversion: 2.1 time: 0.035096 Sep 24 19:46:11.672205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 109/202] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:11 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:46:11.808828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:11.811056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:11.817753 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:11.818246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:11.818683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:11.819400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:11.819911 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:11.820384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:11.835578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] HTTP exception thrown: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Request method failure captured: Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e/os-volume_attachments HTTP/1.1 Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL14_HKqvEvgDoAt79980Wr6ihGHUbztLEATczneWcm4AwNNnoZSIFNGjAmoWi1KF7cj21O8S9aGzrewDTdVMPCaCSJIjBiKx429ON5SxIRU9BqKJAFu3s3zZNQfoPw8Hx-iVv5v2yA5QOcwsVEdoD43r9sBMCaon13IAhAkK2h5uNLw Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:46:11.839787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 89b20ec0ede5470eaa33e1ea934991d9 Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.842699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'server_id': '80852886-4e5c-4ecf-acf0-400d0e5dea6e'} Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:46:11.844198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:11.846554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:11.850047 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Returning 404 to user: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:46:11.850047 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-799f5a70-27f9-46b1-9837-adc82bb0bbec tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036889 Sep 24 19:46:11.850047 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 94/203] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:46:11 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:46:12.526504 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:12.527629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:12.545779 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:12.547495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:12.551657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:12.552337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:12.552819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:12.553240 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:12.713839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:12.723767 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-753c8437-e17b-4cce-b844-85fc6bcc3237 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.200743 Sep 24 19:46:12.724911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 110/204] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:12 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:13.753585 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:13.754366 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:13.760407 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:13.760897 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:13.761328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:13.762023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:13.762478 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:13.762949 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:13.914964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:13.927058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d483d295-b713-4712-932d-0d150dd1993b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.177372 Sep 24 19:46:13.927675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 95/205] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:13 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:14.961746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:14.963410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:14.972145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:14.972743 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:14.973694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:14.974499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:14.975694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:14.975694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:15.116226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:15.124727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-dbc51336-943b-4674-b3da-d74aa099bc3e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.167335 Sep 24 19:46:15.125287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 111/206] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:14 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:16.149917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:16.151065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:16.158923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:16.159683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:16.160126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:16.160933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:16.161413 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:16.161821 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:16.301211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:16.301971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:16.308649 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:16.309381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:16.310551 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:16.311913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:16.312385 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:16.312818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:16.343784 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:16.352643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-501718f1-1aeb-4e46-94f4-122c1a9b797a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.208127 Sep 24 19:46:16.353329 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 96/207] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:16 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:16.472164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] HTTP exception thrown: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Request method failure captured: Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e HTTP/1.1 Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL14_HKqvEvgDoAt79980Wr6ihGHUbztLEATczneWcm4AwNNnoZSIFNGjAmoWi1KF7cj21O8S9aGzrewDTdVMPCaCSJIjBiKx429ON5SxIRU9BqKJAFu3s3zZNQfoPw8Hx-iVv5v2yA5QOcwsVEdoD43r9sBMCaon13IAhAkK2h5uNLw Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:46:16.473741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 89b20ec0ede5470eaa33e1ea934991d9 Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.474950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '80852886-4e5c-4ecf-acf0-400d0e5dea6e'} Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:46:16.475624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.476692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.477773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Returning 404 to user: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:46:16.477773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-95c11484-38b9-405b-b772-5a911e8812c1 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 404 len: 111 microversion: 2.1 time: 0.188367 Sep 24 19:46:16.477773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 112/208] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:46:16 2022] DELETE /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:46:16.484665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:16.485304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] [instance: 80852886-4e5c-4ecf-acf0-400d0e5dea6e] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:16.491252 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:16.491702 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:16.492138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:16.492831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:16.493284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:16.493709 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:16.508000 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] HTTP exception thrown: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Request method failure captured: Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e HTTP/1.1 Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL14_HKqvEvgDoAt79980Wr6ihGHUbztLEATczneWcm4AwNNnoZSIFNGjAmoWi1KF7cj21O8S9aGzrewDTdVMPCaCSJIjBiKx429ON5SxIRU9BqKJAFu3s3zZNQfoPw8Hx-iVv5v2yA5QOcwsVEdoD43r9sBMCaon13IAhAkK2h5uNLw Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:46:16.510175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0900418261fc4370bbf30ffcc668c4c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 0900418261fc4370bbf30ffcc668c4c5 Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-DeleteServersTestJSON-446838322 Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 89b20ec0ede5470eaa33e1ea934991d9 Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-DeleteServersTestJSON-446838322-project Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.511617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '80852886-4e5c-4ecf-acf0-400d0e5dea6e'} Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:46:16.512532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. Sep 24 19:46:16.513997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:16.515177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] Returning 404 to user: Instance 80852886-4e5c-4ecf-acf0-400d0e5dea6e could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:46:16.515177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-70af1a69-5b56-49bc-9a59-ccb5ab034047 tempest-DeleteServersTestJSON-446838322 tempest-DeleteServersTestJSON-446838322-project] 10.222.0.55 "GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e" status: 404 len: 111 microversion: 2.1 time: 0.031511 Sep 24 19:46:16.515177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 97/209] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:16 2022] GET /compute/v2.1/servers/80852886-4e5c-4ecf-acf0-400d0e5dea6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:46:17.378898 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:17.379556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:17.386690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:17.387179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:17.387670 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:17.388415 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:17.389768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:17.392632 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:17.580587 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:17.590059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0d9a1126-8af2-414f-95aa-a9b004799f08 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.214991 Sep 24 19:46:17.590853 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 113/210] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:17 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:18.619309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:18.620654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:18.624766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=49 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:18.634879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:18.635893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:18.636975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:18.638386 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:18.639347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:18.640235 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:18.816230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:18.825062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7203892b-6260-415a-b3e7-3d62484e6d9c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.213178 Sep 24 19:46:18.825977 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 98/211] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:18 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:19.853740 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:19.854338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:19.861502 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:19.862285 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:19.862730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:19.863608 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:19.864339 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:19.864775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:20.312399 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:20.322525 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-775ce14a-173f-4ba9-9763-e1db9184840b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.471918 Sep 24 19:46:20.323369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 114/212] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:19 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:21.345937 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:21.346551 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:21.354154 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:21.354682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:21.355094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:21.355831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:21.356374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:21.357396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:21.365034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:21.511373 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:21.519173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-83696446-9d32-47db-98f6-eda923ac61be tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.177298 Sep 24 19:46:21.519769 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 99/213] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:21 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:22.543134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:22.544901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:22.557758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:22.558113 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:22.558689 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:22.559725 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:22.560212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:22.560745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:22.709039 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:22.717871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a506b713-8e41-4725-b8d2-dd886860a280 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.179541 Sep 24 19:46:22.718507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 115/214] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:22 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:23.741450 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:23.743136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:23.750896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:23.751402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:23.751893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:23.752689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:23.753180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:23.753628 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:23.902108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:23.910651 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-679a3d6f-508c-4cf3-9be1-191424b89c3f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.173120 Sep 24 19:46:23.911507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 100/215] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:23 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:24.937247 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:24.938627 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:24.947691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:24.948279 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:24.948804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:24.949604 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:24.950734 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:24.951269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:24.959183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:25.139212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:25.152574 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1afb7512-588b-41e5-9d9c-48595561fee3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.221267 Sep 24 19:46:25.154135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 116/216] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:24 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:26.178782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:26.179344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:26.188515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:26.189048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:26.189491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:26.190452 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:26.191304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:26.191924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:26.623309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:26.643361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9d3b64b1-f654-460c-bce8-81f609d35dd8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.465814 Sep 24 19:46:26.644061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 101/217] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:26 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:27.670703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:27.672535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:27.688657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:27.689417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:27.690057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:27.690953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:27.691796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:27.692416 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:27.943926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:27.953100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e27871a8-5a95-441d-9d7c-74514896ba53 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1520 microversion: 2.1 time: 0.288212 Sep 24 19:46:27.968287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 117/218] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:27 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:28.983812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:28.984850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:28.995869 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:28.996689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:28.997479 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:28.998912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:28.999733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:29.000582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:29.286499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:29.309782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-49ddade3-e6d0-4aff-8890-6c63531f41a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1500 microversion: 2.1 time: 0.334058 Sep 24 19:46:29.318762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 102/219] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:28 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1500 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:29.342817 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:29.351519 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:29.359575 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:29.366310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:29.367792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:29.368736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:29.369550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:29.370317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:29.650709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:29.663131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-87e77345-3eb2-4b65-b1b3-4314c0b71cfb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1516 microversion: 2.1 time: 0.325446 Sep 24 19:46:29.664117 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 118/220] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:29 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1516 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:31.256415 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:31.261217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:31.273592 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:31.274332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:31.275045 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:31.276267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:31.277031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:31.277681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:31.330347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lazy-loading 'flavor' on Instance uuid afc80c86-d224-4d77-9985-9658a8c0a47b {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:46:31.589949 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-95e7159f-3479-499d-a478-c332120ffdbd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b/action" status: 200 len: 32 microversion: 2.1 time: 0.340681 Sep 24 19:46:31.592398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 103/221] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:46:31 2022] POST /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b/action => generated 32 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:46:31.601757 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:31.603030 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:31.611787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:31.612816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:31.613637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:31.614646 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:31.615321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:31.616077 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:31.933726 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:31.950104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-bb937114-aac4-4b70-ab85-2ed8ef1d4437 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.347197 Sep 24 19:46:31.955690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 119/222] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:31 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:32.974840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:32.976438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:32.988128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:32.989003 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:32.989623 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:32.990803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:32.991450 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:32.992067 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:33.199487 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:33.220204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4d5c6517-0bf9-44b3-8746-285b0b69b118 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.249079 Sep 24 19:46:33.236419 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 104/223] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:32 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:34.250175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:34.251663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:34.267854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:34.268485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:34.269425 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:34.273311 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:34.273819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:34.274311 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:34.589866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:34.604762 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-605a86d7-47dc-4898-89ae-9d9b6e9fe85e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.359118 Sep 24 19:46:34.615583 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 120/224] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:34 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:35.632475 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:35.633099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:35.663652 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:35.664445 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:35.665088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:35.666357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:35.667034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:35.667687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:36.263976 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:36.272565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-44ee1645-b2a2-4183-8e28-ac9ad60c5396 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.643862 Sep 24 19:46:36.273710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 105/225] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:35 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:37.299302 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:37.300100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:37.310325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:37.311454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:37.311905 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:37.312641 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:37.313113 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:37.313545 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:37.508008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:37.517687 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-bd5b0e40-56ba-48ff-a7bc-a34f4836403c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.224826 Sep 24 19:46:37.518265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 121/226] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:37 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:38.542063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:38.542063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:38.551635 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:38.552539 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:38.553212 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:38.554159 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:38.554825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:38.555510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:38.748673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:38.757556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-591a405f-a21b-48f6-85b3-f8b16261a699 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.220904 Sep 24 19:46:38.758752 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 106/227] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:38 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:39.785093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:39.785748 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:39.788966 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=34 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:39.797720 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:39.798652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:39.799257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:39.800182 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:39.800912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:39.801353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:39.971282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:39.982957 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d18f7162-478e-4e3e-b411-33ca6b7da7a9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.202042 Sep 24 19:46:39.983565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 122/228] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:39 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:40.543156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:40.544136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:40.555061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:40.562353 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:40.564107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:40.564880 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:40.565362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:40.565799 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:40.618391 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5901fb7d-e021-409b-bd4e-ea1b118ce7e8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/ips" status: 200 len: 149 microversion: 2.1 time: 0.083944 Sep 24 19:46:40.628960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 107/229] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:46:40 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/ips => generated 149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:46:41.006902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:41.008348 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:41.018108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:41.018621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:41.019070 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:41.019830 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:41.020365 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:41.020733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:41.375547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:41.385842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f041ac8c-1602-4588-a76d-44761d81a376 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.381493 Sep 24 19:46:41.386652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 123/230] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:41 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:42.412930 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:42.413549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:42.420173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:42.420669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:42.421109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:42.421815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:42.422273 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:42.422700 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:42.588203 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:42.598289 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3f1a510c-98af-40d0-ad1e-1860c2d5e1c4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.189088 Sep 24 19:46:42.599788 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 108/231] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:42 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:43.568893 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fec16fd3-0f19-430a-9f1a-e2395994477b"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:43.571286 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:43.578341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:43.579057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:43.579840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:43.580726 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:43.581346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:43.581934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:43.627506 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:43.629335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:43.638386 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:43.638873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:43.640222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:43.641387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:43.641994 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:43.642706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:43.844241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:43.851839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-20cd63f4-ec3e-4c50-a008-9ed2bdae92c1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.230239 Sep 24 19:46:43.864839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 109/232] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:43 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:44.099264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a602b196-921e-4c2d-80e0-562443f8abf3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.534043 Sep 24 19:46:44.100365 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 124/233] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:46:43 2022] POST /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:46:44.877125 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:44.877740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:44.885532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:44.887581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:44.888202 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:44.891938 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:44.893812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:44.893812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:45.102472 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:45.116991 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a303d249-b94e-4942-9c42-a82803e482c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.242481 Sep 24 19:46:45.118380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 110/234] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:44 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:46.142996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:46.143732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:46.155473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:46.156351 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:46.156980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:46.157889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:46.158522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:46.158977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:46.333088 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:46.348564 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fb5d21d8-0ede-45ec-93b8-996bddb6870b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.211107 Sep 24 19:46:46.349364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 125/235] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:46 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:47.373612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:47.375394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:47.390927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:47.392157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:47.393588 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:47.396019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:47.398576 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:47.399600 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:47.694481 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:47.708549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6329e71a-ca5a-407a-b17b-4515b3c6bc6a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.340409 Sep 24 19:46:47.721822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 111/236] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:47 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:48.752827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:48.754086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:48.761942 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:48.762425 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:48.763068 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:48.763816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:48.764274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:48.764858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:48.957409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:48.970473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2fc37b95-bfed-497c-98a7-6718581845cc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.222158 Sep 24 19:46:48.983799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 126/237] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:48 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:49.995479 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:49.996954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:50.002811 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=28 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:50.005034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:50.005809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:50.006424 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:50.007497 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:50.007962 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:50.008389 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:50.040374 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7ccc91fb-f678-422f-aeb3-2e5497ec15ac tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Action: 'create', calling method: .version_select at 0x7f5417e95430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-391288128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2+Tma0vhTP2Emd0bV/YHH7YNuvIw321m69JuhfeqFfKK2DIUaWc6eB1fZJGkI0EXpcyfzHajmyvlKYeZuURHwIMtkYygJ0eEKE+RZpV6a3Pv1s2wNRPOO1qH1gls4/fw=="}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:50.079766 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-7ccc91fb-f678-422f-aeb3-2e5497ec15ac tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Getting quotas for project 8cb38d1aae344b868976df799b74b0f5. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:46:50.084604 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-7ccc91fb-f678-422f-aeb3-2e5497ec15ac tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Getting quotas for user 47773b38da48458fa356f34d259d3478 and project 8cb38d1aae344b868976df799b74b0f5. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:46:50.121470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7ccc91fb-f678-422f-aeb3-2e5497ec15ac tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.087367 Sep 24 19:46:50.121470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 127/238] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:46:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:46:50.244301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1134386682", "imageRef": "304038b4-821d-4363-8130-2275950b2666", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-391288128", "networks": [{"uuid": "5d1c28c8-1a1e-4312-b6d1-052852f5857f"}]}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:50.262745 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:50.272222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a4465063-844f-4532-903b-182a7ed0c05f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.280787 Sep 24 19:46:50.273060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 112/239] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:49 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:50.314909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] validate_networks() for [('5d1c28c8-1a1e-4312-b6d1-052852f5857f', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:46:50.773153 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:46:50.773876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:46:50.774362 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:46:50.774775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:46:50.775191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:46:50.786658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:50.787154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:50.787628 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:50.788367 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:50.788855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:50.789254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:50.809723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Getting quotas for project 8cb38d1aae344b868976df799b74b0f5. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:46:50.814556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Getting quotas for user 47773b38da48458fa356f34d259d3478 and project 8cb38d1aae344b868976df799b74b0f5. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:46:50.826750 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:46:50.829607 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='304038b4-821d-4363-8130-2275950b2666',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:46:50.884251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-31124ded-11be-448b-abcc-91ee4588245e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643737 Sep 24 19:46:50.885330 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 128/240] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 19:46:50.896158 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d0597f06-2f20-47a6-a5c5-863bb53e8251 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:50.896774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d0597f06-2f20-47a6-a5c5-863bb53e8251 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:50.957540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d0597f06-2f20-47a6-a5c5-863bb53e8251 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:50.964918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d0597f06-2f20-47a6-a5c5-863bb53e8251 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1258 microversion: 2.1 time: 0.072432 Sep 24 19:46:50.965863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 113/241] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:50 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:51.302097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:51.302797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:51.312177 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:51.312857 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:51.313706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:51.314841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:51.315661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:51.316517 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:51.525293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:51.534812 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-10bf37bb-f950-4229-8c34-123eedc33e59 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.239587 Sep 24 19:46:51.535398 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 129/242] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:51 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:51.990288 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:51.990931 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:51.997590 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:51.998084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:51.998525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:51.999233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:51.999717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:52.000153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:52.005223 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:52.077056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:52.089011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-00754b53-59fb-4369-b702-e9b8731773a9 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1262 microversion: 2.1 time: 0.103672 Sep 24 19:46:52.091003 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 114/243] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:51 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1262 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:52.561254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:52.561980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:52.570829 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:52.571327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:52.571822 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:52.572546 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:52.572993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:52.573606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:52.733636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:52.743937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-64a935aa-f858-4083-ad2c-bece60f61bf6 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.187408 Sep 24 19:46:52.744524 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 130/244] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:52 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:53.014382 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4df69b99-7070-4d3e-940c-ac31b1563cdb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: .version_select at 0x7f5417f123a0>, body: {"keypair": {"name": "tempest-keypair-2068597756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOizigU8XyphsypURkAPjSMhK2tN+/tPXDxJRatJg1OCOUXjKz133766puZdZcACJCQ5Qczud7x9VT8xL0W11o5kYAU+2Embx1Wu+sLZRN/+KpIXhUkJpTWLL0XHxZTLxw=="}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:53.039262 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-4df69b99-7070-4d3e-940c-ac31b1563cdb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:46:53.044917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-4df69b99-7070-4d3e-940c-ac31b1563cdb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:46:53.100244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4df69b99-7070-4d3e-940c-ac31b1563cdb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089088 Sep 24 19:46:53.101081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 115/245] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:46:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:46:53.116326 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:53.117029 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:53.124086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:53.124979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:53.125443 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:53.126349 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:53.127021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:53.127710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:53.208876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:53.219503 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6e8d2a6c-95df-479d-bdd1-b877d60ca26d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1310 microversion: 2.1 time: 0.106951 Sep 24 19:46:53.221168 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 131/246] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:53 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:53.769932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:53.770705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:53.780181 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:53.780740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:53.781191 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:53.781922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:53.782563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:53.782830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:54.002588 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:54.025991 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2e5b19f8-90b1-4200-893b-0039c7d93c0b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.261186 Sep 24 19:46:54.028077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 116/247] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:53 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:54.246791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:54.248397 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:54.264135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:54.272247 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:54.272741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:54.273609 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:54.274121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:54.274549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:54.392335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:54.404089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-eecf3626-0967-41d4-b866-491f470afbbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1310 microversion: 2.1 time: 0.160391 Sep 24 19:46:54.404948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 132/248] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:54 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:55.053945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:55.054575 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:55.071942 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.072550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.073128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.073887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.074411 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.076467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.248402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-70038118", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccacbae6-4eff-4b60-b850-003263f855e0"}], "security_groups": [{"name": "tempest-securitygroup--551172728"}], "key_name": "tempest-keypair-2068597756", "user_data": "}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:55.467613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] validate_networks() for [('ccacbae6-4eff-4b60-b850-003263f855e0', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:46:55.526313 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:55.537646 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4c18d967-f004-4f23-8a0c-2ed22deb4134 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1502 microversion: 2.1 time: 0.487818 Sep 24 19:46:55.539496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 117/249] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:55 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1502 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:55.546827 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:55.548033 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:55.557349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.560026 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.560761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.561739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.562421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.563066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.698986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:55.718303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-93d145c0-f7ac-4cb5-b962-c3cc116eb947 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1316 microversion: 2.1 time: 0.176848 Sep 24 19:46:55.718896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 118/250] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:55 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:55.724304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bce6ad9-aede-425e-b415-cde823966847"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:55.727668 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:55.735243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.736130 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.736972 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.737981 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.738795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.739530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.782325 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] HTTP exception thrown: Cannot 'attach_volume' instance afc80c86-d224-4d77-9985-9658a8c0a47b while it is in vm_state rescued Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Request method failure captured: Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: POST /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b/os-volume_attachments HTTP/1.1 Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 74 Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL144Co_KYV-KP0xPXbouvg98k2x3g34lAIMyI70xmmjXTgvwWCHJd0_jdF8LSgviKk2jF6tlX0pyXrudOUvOaHHPsytvnECLiNmgk2Wdx9PSH6ZiD_rpfPYCHphy5NXskDwR5s0-Y2b8_i-d5i6VrWEU4EKOAfPNzv2JMLiDfba29Qc Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:46:55.784759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: f417a94fed274bfbb88d23677a4877a7 Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {"volumeAttachment": {"volumeId": "9bce6ad9-aede-425e-b415-cde823966847"}} Sep 24 19:46:55.785988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Cannot 'attach_volume' instance afc80c86-d224-4d77-9985-9658a8c0a47b while it is in vm_state rescued Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'server_id': 'afc80c86-d224-4d77-9985-9658a8c0a47b', 'body': {'volumeAttachment': {'volumeId': '9bce6ad9-aede-425e-b415-cde823966847'}}} Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afc80c86-d224-4d77-9985-9658a8c0a47b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:46:55.786707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance afc80c86-d224-4d77-9985-9658a8c0a47b while it is in vm_state rescued Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:46:55.787900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:46:55.789201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:46:55.789201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:46:55.789201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance afc80c86-d224-4d77-9985-9658a8c0a47b while it is in vm_state rescued Sep 24 19:46:55.789201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:46:55.789510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Returning 409 to user: Cannot 'attach_volume' instance afc80c86-d224-4d77-9985-9658a8c0a47b while it is in vm_state rescued {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:46:55.790795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c39040ee-d72a-4bde-bc2f-da01f33a4f16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070271 Sep 24 19:46:55.792048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 119/251] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:46:55 2022] POST /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 19:46:55.804781 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:46:55.805705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:55.829849 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.830813 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.832642 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.834177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:55.835241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:55.836301 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:55.974635 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-38694328-46e3-4608-90a2-f85ec31be0f4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b/action" status: 202 len: 0 microversion: 2.1 time: 0.176722 Sep 24 19:46:55.975736 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 120/252] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:46:55 2022] POST /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:46:56.015979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:56.017015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:56.019255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:46:56.019904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:46:56.020394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:46:56.020873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:46:56.021485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:46:56.025541 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:56.026357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:56.026974 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:56.029853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:56.030354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:56.030815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:56.047283 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:56.048796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:56.049873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:56.051295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:56.052687 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:56.054134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:56.065381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:46:56.100075 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:46:56.109966 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:46:56.175950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:46:56.178570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:46:56.298980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3189d1d2-29e7-4c36-8b7f-762a02f884dd tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.057270 Sep 24 19:46:56.312077 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 133/253] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:46:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:46:56.336348 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4e1a5900-7282-49d8-a49b-fd1366cefca2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:56.337249 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4e1a5900-7282-49d8-a49b-fd1366cefca2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:56.639543 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4e1a5900-7282-49d8-a49b-fd1366cefca2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:56.653028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4e1a5900-7282-49d8-a49b-fd1366cefca2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1240 microversion: 2.1 time: 0.338856 Sep 24 19:46:56.656013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 134/254] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:56 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1240 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:56.746717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:56.747997 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:56.769787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:56.773580 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:56.775859 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:56.778244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:56.778968 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:56.784287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:56.811876 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:56.821950 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a6ca4794-5d24-4595-89f7-3d5824f1ec60 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1510 microversion: 2.1 time: 0.824193 Sep 24 19:46:56.824793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 121/255] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:55 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1510 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:57.074724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:57.075703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:57.082731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.083529 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.084041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.084836 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.085384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.086070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.195445 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-be8a415c-48bc-47d6-822c-55ea300a3934 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/ips" status: 200 len: 151 microversion: 2.20 time: 0.125316 Sep 24 19:46:57.220866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 122/256] 10.222.0.55 () {60 vars in 1289 bytes} [Sat Sep 24 19:46:57 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/ips => generated 151 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 19:46:57.392370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:57.404798 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-54534d24-ccf6-4407-9544-31098df4ede7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.662229 Sep 24 19:46:57.405383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 135/257] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:56 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:57.570545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:57.571198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:57.589113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.593462 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.594436 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.595885 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.601115 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.601931 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.678158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:57.678784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:57.690686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.691186 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.692260 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2ed755e8-cad4-4f7e-b796-79fbf411e3c2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/ips" status: 200 len: 147 microversion: 2.1 time: 0.126849 Sep 24 19:46:57.709338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.710666 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.713304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.713628 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.742848 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 123/258] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:46:57 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/ips => generated 147 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:46:57.852224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:57.853022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:57.866592 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.876388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.877143 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.908954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:57.909080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:57.909541 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:57.945689 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:57.962990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f015fc4b-9016-429a-83b8-8c3da6acb2b0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1236 microversion: 2.1 time: 0.288604 Sep 24 19:46:57.997766 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 136/259] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:57 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1236 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:58.445009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:58.447070 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:58.476343 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:58.477818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:58.486560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:58.490484 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:58.491878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:58.493383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:58.696007 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:58.717215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-282e2f9d-85bb-4eec-9421-5b0a92acae20 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1510 microversion: 2.1 time: 0.868885 Sep 24 19:46:58.718455 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 124/260] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:57 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1510 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:58.787831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:58.802137 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-185929c0-1023-44e2-976c-2972f4f9f673 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.363801 Sep 24 19:46:58.803340 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 137/261] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:58 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:46:59.010393 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:59.017186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:59.033617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:59.034444 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:59.034845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:59.035780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:59.041978 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:59.042842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:59.251813 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:46:59.262653 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3b25f622-c2ff-48de-88b9-04a3d211d1f7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1292 microversion: 2.1 time: 0.262058 Sep 24 19:46:59.265987 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 125/262] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:58 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1292 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:46:59.752057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:59.753566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:59.779416 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:59.780055 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:59.780505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:59.781457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:59.782887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:59.786664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:59.833071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:46:59.833071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:46:59.848688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:59.858281 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:59.862261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:46:59.872711 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:46:59.876162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:46:59.876854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:00.225174 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:00.236318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1dd19e40-4cce-4a29-a9aa-aafb797f4b3d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1510 microversion: 2.1 time: 0.493454 Sep 24 19:47:00.237538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 138/263] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:59 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:00.290021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:00.290690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:00.305240 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:00.308343 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:00.309427 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:00.311004 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:00.313842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:00.314532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:00.438332 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:00.452513 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6fe67430-dec0-47db-9ec6-b02a3228067a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1292 microversion: 2.1 time: 0.169950 Sep 24 19:47:00.466344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 139/264] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:00 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:00.577978 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:00.578632 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:00.584895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:00.585454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:00.585964 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:00.586761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:00.587221 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:00.587801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:00.633378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:00.647502 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-509c9a3b-09f3-40be-963c-90005d346bfa tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.819749 Sep 24 19:47:00.653901 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 126/265] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:46:59 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:00.659190 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lazy-loading 'flavor' on Instance uuid bff567a7-861e-469a-913d-add40f3220c9 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:47:00.751109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-5d99c374-7305-4518-8f88-ff54e21e7b71 req-960e2b77-2004-495e-8755-016c1cbcba2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241", "tag": "df4d7c5e-93cd-42b9-998b-7c78ab449dc1"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:00.780096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-5d99c374-7305-4518-8f88-ff54e21e7b71 req-960e2b77-2004-495e-8755-016c1cbcba2e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:00.780780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-5d99c374-7305-4518-8f88-ff54e21e7b71 req-960e2b77-2004-495e-8755-016c1cbcba2e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:00.781304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-5d99c374-7305-4518-8f88-ff54e21e7b71 req-960e2b77-2004-495e-8755-016c1cbcba2e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:00.804941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-5d99c374-7305-4518-8f88-ff54e21e7b71 req-960e2b77-2004-495e-8755-016c1cbcba2e service nova] Creating event network-changed:df4d7c5e-93cd-42b9-998b-7c78ab449dc1 for instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 on hv-cinder-85919 Sep 24 19:47:00.812343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-5d99c374-7305-4518-8f88-ff54e21e7b71 req-960e2b77-2004-495e-8755-016c1cbcba2e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065729 Sep 24 19:47:00.813406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 127/266] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:01.110457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f6846e7e-275d-4d9d-8031-a0e26bb8038e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/action" status: 202 len: 0 microversion: 2.20 time: 0.537181 Sep 24 19:47:01.120993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 140/267] 10.222.0.55 () {62 vars in 1319 bytes} [Sat Sep 24 19:47:00 2022] POST /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:47:01.129979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:01.131117 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:01.152718 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.153368 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.155041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:01.156823 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.157624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.158278 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:01.265372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:01.266100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:01.291549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.292176 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.295124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:01.297473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.304214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.309369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:01.506024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:01.519354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:01.521276 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:01.522863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-fc79a3b1-7eaa-4bdd-8d25-47a5f7b5749d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.398476 Sep 24 19:47:01.524070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 128/268] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:01 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:01.530542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aa53a43-857c-4053-9395-08f1e4d4dbc4"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:01.533451 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:01.548139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.550534 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.551180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:01.552325 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.556041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.556710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:01.755986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:01.782127 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-79f191fc-6e49-4fb1-931f-c953553a457d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1510 microversion: 2.1 time: 0.522318 Sep 24 19:47:01.797820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 141/269] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:01 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1510 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:01.814389 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:01.819862 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:01.835028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.836745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.838976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:01.843303 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:01.844045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:01.845709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:02.382336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:02.391090 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-cd5c4d62-b028-49ca-8cf8-cf106e69876f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1292 microversion: 2.1 time: 0.588380 Sep 24 19:47:02.403175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 142/270] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:01 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1292 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:02.409921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:02.410556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:02.427595 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:02.428335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:02.428999 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:02.430122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:02.430890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:02.442514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:02.664437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:02.676853 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2ae51dbd-4284-49f5-bcee-c856a1044ea3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.272126 Sep 24 19:47:02.677538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 143/271] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:02 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:02.684322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:02.685031 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:02.693659 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:02.694152 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:02.694695 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:02.695520 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:02.696163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:02.696767 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:03.042373 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:03.053023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=6 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:03.075678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:03.081465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:03.084290 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6984d3a6-ca65-42f6-9d74-c6ebc2a4b71b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.404510 Sep 24 19:47:03.085455 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 144/272] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:02 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:03.093215 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:03.094694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:03.114302 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:03.119655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:03.121769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:03.122749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:03.123509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:03.124201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:03.513901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:03.522755 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-681ce41e-aea1-4301-b5be-52c4ba13fb7a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1510 microversion: 2.1 time: 0.436029 Sep 24 19:47:03.523347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 145/273] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:03 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:03.544650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:03.545263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:03.551591 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:03.552075 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:03.552517 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:03.553474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:03.553672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:03.554098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:03.667636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:03.684869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f8e63201-c10d-4e4b-bc7e-c6e30b56aa1d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1292 microversion: 2.1 time: 0.143320 Sep 24 19:47:03.685858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 146/274] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:03 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1292 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:03.707247 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:03.708021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:03.716667 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:03.717207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:03.717639 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:03.718368 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:03.718851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:03.719359 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:03.922897 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:03.937779 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5408847b-cc56-4457-9b8b-9826eac7ee38 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.234668 Sep 24 19:47:03.952344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 147/275] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:03 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:04.128327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:04.128536 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:04.138446 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:04.142551 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:04.143228 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:04.144380 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:04.144855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:04.145293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:04.326335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:04.339208 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:04.341932 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:04.344592 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ed37c054-a3a3-4719-8ccd-0686c17bd955 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.219860 Sep 24 19:47:04.359452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 148/276] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:04 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:04.549742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:04.550768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:04.589743 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:04.592732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:04.593298 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:04.595739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:04.596381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:04.598457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:04.655416 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:04.903008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:04.937668 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e7320de4-ed57-4540-bd0c-f8f1b31024ed tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1510 microversion: 2.1 time: 0.381288 Sep 24 19:47:04.938916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 149/277] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:04 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:04.945325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:04.946147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:04.953347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:04.955150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:04.960204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:04.960865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:04.961807 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:04.962483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:04.963093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:05.086162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:05.095881 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-572f2cec-368e-4e93-97b2-d001e205c4f2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1292 microversion: 2.1 time: 0.155434 Sep 24 19:47:05.111578 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 150/278] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:04 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1292 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:05.116059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:05.116648 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:05.134628 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:05.135321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:05.135776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:05.137609 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:05.138293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:05.138808 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:05.454549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:05.464075 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-53a1ad76-4f73-4c86-bd22-80e32bf913a2 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.366058 Sep 24 19:47:05.465787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 151/279] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:05 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:05.489277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:05.495263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:05.524740 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:05.530497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:05.531554 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:05.532524 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:05.533507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:05.534156 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:06.066525 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=4 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:06.127083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:06.152993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:06.160657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:06.167761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-919bfea0-b7b9-4a8e-b5bf-c20b68f0d217 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.681905 Sep 24 19:47:06.171617 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 152/280] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:05 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:06.226646 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:06.228090 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:06.257417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:06.262612 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:06.267381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:06.270742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:06.271838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:06.275797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:06.408688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b0517783-80f0-4874-8192-889bb0f5ad19 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.881887 Sep 24 19:47:06.410381 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 129/281] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:47:01 2022] POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-volume_attachments => generated 194 bytes in 4885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:06.425207 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:06.427371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:06.449315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:06.450434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:06.451189 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:06.454104 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:06.454617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:06.462647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:06.630553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:06.639295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:06.646252 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=18 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:06.649158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-850e7aea-d5ef-40b3-b48f-a281b9cca9d4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1516 microversion: 2.1 time: 0.456709 Sep 24 19:47:06.649882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 153/282] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:06 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:06.652471 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-196fb03c-df13-4987-ac0c-ca4aaf477adf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1292 microversion: 2.1 time: 0.239334 Sep 24 19:47:06.655317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 130/283] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:06 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1292 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:06.714529 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:06.715534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:06.733885 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:06.734381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:06.734822 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:06.735979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:06.738687 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:06.739273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:07.145437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:07.167197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-69589a1f-ec08-4e14-ab4d-a324a82d1f9a tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.514813 Sep 24 19:47:07.170981 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 154/284] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:06 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:07.223670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:07.224278 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:07.237909 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:07.247070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:07.247832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:07.250085 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:07.254400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:07.256004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:07.272564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:07.687477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:07.688345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:07.709159 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:07.710036 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:07.710655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:07.711650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:07.712359 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:07.712947 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:07.885774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:07.899888 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5b857abe-71b2-497f-acf2-fe9f43969093 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1292 microversion: 2.1 time: 0.217711 Sep 24 19:47:07.901148 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 155/285] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:07 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1292 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:08.009008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:08.022148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:08.024076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:08.029215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-eb584cb5-9c61-4954-ac71-56f5a9f72a9a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.811476 Sep 24 19:47:08.034748 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 131/286] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:07 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:08.202892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:08.203693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:08.224957 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:08.225763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:08.228083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:08.231638 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:08.231638 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:08.231638 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:08.469224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5c0d475c-b03b-4927-9941-226b1266199a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'create', calling method: .version_select at 0x7f5417d9e040>, body: {"keypair": {"name": "tempest-keypair-787643600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+sZUEv0b3L+2hBHXrMMUHIaWCPt0SJzg8dxcnMTptaix9i4UZDtKrMYebMAptPthJImj+vZJMh9a59JgkwXfDyUlOTYTwIwUO8WGoaQxbttBHCS/VgmUIH0sNJPgHSDA=="}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:08.528332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-5c0d475c-b03b-4927-9941-226b1266199a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for project 0d671773b58240b1988f7c56ec6753b5. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:47:08.533704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-5c0d475c-b03b-4927-9941-226b1266199a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for user f417a94fed274bfbb88d23677a4877a7 and project 0d671773b58240b1988f7c56ec6753b5. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:47:08.576055 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5c0d475c-b03b-4927-9941-226b1266199a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112192 Sep 24 19:47:08.584745 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 132/287] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:47:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:47:08.886048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:08.902707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b9471c8f-542f-4cb0-a9f3-5e32e3023b90 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.710382 Sep 24 19:47:08.904052 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 156/288] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:08 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:08.927932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:08.928645 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:08.937928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:08.938717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:08.939330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:08.940313 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:08.940930 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:08.941510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:09.058034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:09.073142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:09.074542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:09.075340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9f647eeb-6eb9-4777-9715-bcc712e26741 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1300 microversion: 2.1 time: 0.152263 Sep 24 19:47:09.086238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 133/289] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:08 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:09.114366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:09.114916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:09.117095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:09.118226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:09.119135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:09.119929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:09.542111 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:09.567680 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:09.570264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:09.572581 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ee323941-5e96-4a83-8d12-4f30d77e6a83 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.503829 Sep 24 19:47:09.576263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 157/290] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:09 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:09.928165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:09.928794 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:09.943835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:09.944605 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:09.945067 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:09.945820 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:09.946292 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:09.947514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:10.117132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:10.117766 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:10.135606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:10.140476 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:10.141227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:10.142934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:10.143637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:10.144460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:10.351918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:10.358388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:10.370862 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8ec30673-7ca8-4f22-9974-14b28dd702b3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1298 microversion: 2.1 time: 0.264634 Sep 24 19:47:10.377811 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 158/291] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:10 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1298 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:10.381739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d8fd0d08-fa98-47b2-972b-af473385d316 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.457216 Sep 24 19:47:10.387580 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 134/292] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:09 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:10.614625 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:10.616869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:10.641821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:10.646269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:10.651260 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:10.654110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:10.654772 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:10.655968 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:11.063218 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:11.077173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:11.078950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:11.080390 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ed21648d-8122-4a05-9c8d-2976288bbb7c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.475657 Sep 24 19:47:11.085572 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 159/293] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:10 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:11.455552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:11.456191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:11.469738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:11.472080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:11.474189 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:11.475164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:11.487263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:11.487798 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:11.488305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:11.489318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:11.500780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:11.502054 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:11.502729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:11.504928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:11.506900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:11.509941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:11.802424 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:11.814188 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3a1a224d-366a-4ebc-bcee-a6f02a2abf6b tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.363816 Sep 24 19:47:11.815247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 135/294] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:11 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:11.941028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:11.950318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f8d2fd34-ef5e-4478-8ae4-4f0d1d76e105 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.499112 Sep 24 19:47:11.963892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 160/295] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:11 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:12.121709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:12.122456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:12.130893 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:12.131397 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:12.132075 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:12.132966 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:12.133600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:12.134030 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:12.158226 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-23ea14e9-9a5c-44da-bb1d-5cd457171a40 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Action: 'create', calling method: .version_select at 0x7f5417e29ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1495379635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC+RLcUXYDwh64qp22Q9IIB07bdGUnj7tRA6Y8YAO6379rvtImA66yap1DNP+XmkWuqgNA0+bxbtIvQeciDDSiQgYJDSfqZusASnLLOa12/6IWZMwECu8PD3lNPN9FSJA=="}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:12.194029 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-23ea14e9-9a5c-44da-bb1d-5cd457171a40 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Getting quotas for project f5c3250304054594abbaa610e49da216. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:47:12.202345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-23ea14e9-9a5c-44da-bb1d-5cd457171a40 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Getting quotas for user e6cc144c0d804a84a8d35eaa57fab6bb and project f5c3250304054594abbaa610e49da216. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:47:12.242240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-23ea14e9-9a5c-44da-bb1d-5cd457171a40 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.373510 Sep 24 19:47:12.243551 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 136/296] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:47:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:12.569100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:12.604095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:12.613051 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:12.615489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a5fb9edc-95f7-4c12-b8ba-2f4cde47a7d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.497870 Sep 24 19:47:12.640546 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 161/297] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:12 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:47:12.745358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2105209942", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53423030-5132-4717-a9c9-efd8549f6319"}], "security_groups": [{"name": "tempest-securitygroup--1043323602"}], "key_name": "tempest-keypair-787643600", "user_data": "}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:12.842967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:12.843922 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:12.856004 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:12.856514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:12.856952 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:12.868374 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:12.868868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:12.869306 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:13.166844 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] validate_networks() for [('53423030-5132-4717-a9c9-efd8549f6319', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:47:13.224224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:13.253769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4550fdb7-901f-4915-83eb-82508b874baf tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.417561 Sep 24 19:47:13.255097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 162/298] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:12 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:13.263201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:13.264183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:13.272837 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:13.273942 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:13.274707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:13.277649 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:13.278708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:13.279635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:13.958793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:13.969081 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ef1899f9-1682-49b5-a528-a9a6c75307bf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.709815 Sep 24 19:47:13.983458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 163/299] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:13 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:13.988761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-b0269987-b77f-4d66-aa46-70762f192fe4 req-efbd7c01-6a96-4641-83c8-246458005abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff9117a-11ce-4612-9153-8356567961ef", "tag": "2a1ece25-0e03-454a-b128-725cca130281"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:14.004658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b0269987-b77f-4d66-aa46-70762f192fe4 req-efbd7c01-6a96-4641-83c8-246458005abb service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:14.005543 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b0269987-b77f-4d66-aa46-70762f192fe4 req-efbd7c01-6a96-4641-83c8-246458005abb service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:14.005993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b0269987-b77f-4d66-aa46-70762f192fe4 req-efbd7c01-6a96-4641-83c8-246458005abb service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:14.020904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-b0269987-b77f-4d66-aa46-70762f192fe4 req-efbd7c01-6a96-4641-83c8-246458005abb service nova] Creating event network-changed:2a1ece25-0e03-454a-b128-725cca130281 for instance 3ff9117a-11ce-4612-9153-8356567961ef on hv-cinder-85919 Sep 24 19:47:14.037207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-b0269987-b77f-4d66-aa46-70762f192fe4 req-efbd7c01-6a96-4641-83c8-246458005abb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059796 Sep 24 19:47:14.037839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 164/300] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:14.048332 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:14.049050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:14.059124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:14.061202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:14.061956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:14.067308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:14.070768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:14.072290 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:14.113743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:47:14.114302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:47:14.115057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:47:14.116581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:47:14.119034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:47:14.158202 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:14.159176 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:14.160638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:14.162865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:14.163345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:14.166592 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:14.222556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for project 0d671773b58240b1988f7c56ec6753b5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:47:14.248597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Getting quotas for user f417a94fed274bfbb88d23677a4877a7 and project 0d671773b58240b1988f7c56ec6753b5. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:47:14.274403 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:47:14.278191 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:47:14.390132 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2003fc8d-3ead-4b8d-aa99-e38b9d1dae16 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.651308 Sep 24 19:47:14.392445 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 137/301] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:47:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:47:14.406107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:14.407857 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:14.413761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:14.438495 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:14.459044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:14.465066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:14.467737 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:14.468458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:14.469536 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:14.476166 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:14.487788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:14.492162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:14.494053 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-830ef8d9-40a5-48f5-9f0e-7554a01f27f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.454894 Sep 24 19:47:14.495743 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 165/302] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:14 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:14.503631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0ba8055b-119d-490d-b20e-ba933e214994 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:14.506774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0ba8055b-119d-490d-b20e-ba933e214994 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:14.590976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0ba8055b-119d-490d-b20e-ba933e214994 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:14.601620 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0ba8055b-119d-490d-b20e-ba933e214994 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1245 microversion: 2.1 time: 0.102582 Sep 24 19:47:14.602319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 166/303] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:14 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:14.781147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:14.795049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-85fc5174-8415-4f1c-849a-e151b5c79807 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.400369 Sep 24 19:47:14.797199 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 138/304] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:14 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:15.001309 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:15.001942 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:15.021785 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.022285 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.027925 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.028986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.030835 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.032883 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.285658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-523d561a-4d50-46ab-87a2-889cf1e008c5 req-5675c43f-4a9a-4296-af6c-3ae9f5eca235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241", "name": "network-vif-plugged", "status": "completed", "tag": "df4d7c5e-93cd-42b9-998b-7c78ab449dc1"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:15.315977 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-523d561a-4d50-46ab-87a2-889cf1e008c5 req-5675c43f-4a9a-4296-af6c-3ae9f5eca235 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.316616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-523d561a-4d50-46ab-87a2-889cf1e008c5 req-5675c43f-4a9a-4296-af6c-3ae9f5eca235 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.317069 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-523d561a-4d50-46ab-87a2-889cf1e008c5 req-5675c43f-4a9a-4296-af6c-3ae9f5eca235 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.368294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-523d561a-4d50-46ab-87a2-889cf1e008c5 req-5675c43f-4a9a-4296-af6c-3ae9f5eca235 service nova] Creating event network-vif-plugged:df4d7c5e-93cd-42b9-998b-7c78ab449dc1 for instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 on hv-cinder-85919 Sep 24 19:47:15.380131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-523d561a-4d50-46ab-87a2-889cf1e008c5 req-5675c43f-4a9a-4296-af6c-3ae9f5eca235 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098806 Sep 24 19:47:15.382309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 139/305] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:15.384793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:15.395462 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:15.398093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0dae308f-cb3f-423e-a2ec-1f8f216794f1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.401370 Sep 24 19:47:15.400453 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 167/306] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:14 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:15.526789 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:15.527836 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:15.538246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.540447 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.541124 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.544268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.545732 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.546421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.637546 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:15.638800 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:15.651259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.653721 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.656043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.656976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.657629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.658971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.774366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:15.788124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1ace4d8e-1ead-44db-a8ff-401297f121fc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1249 microversion: 2.1 time: 0.164791 Sep 24 19:47:15.789145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 168/307] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:15 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1249 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:15.819248 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:15.824203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:15.843210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.844028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.844635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.845533 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:15.846163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:15.846764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:15.958990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:15.971860 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:15.973353 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:15.974571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-93baa98c-b1ec-48bd-923f-1afdd77fd2e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.452224 Sep 24 19:47:15.975137 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 140/308] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:15 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:16.091208 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:16.101305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-eeece10b-cbf7-47e3-98b2-f6bca537975f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.285923 Sep 24 19:47:16.101979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 169/309] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:15 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:16.424934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:16.426962 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:16.439743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:16.442043 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:16.442610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:16.444625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:16.445118 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:16.445563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:16.781215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:16.789660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-558edd63-ac4b-40eb-ae53-4ad6fd6047df tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.370014 Sep 24 19:47:16.793994 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 141/310] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:16 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:16.812821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:16.813440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:16.834435 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:16.844986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:16.846333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:16.848323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:16.852854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:16.856961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:16.946691 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-16e68b90-5847-4ed3-a358-7b2437316133 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:16.956640 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16e68b90-5847-4ed3-a358-7b2437316133 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:16.957151 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16e68b90-5847-4ed3-a358-7b2437316133 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:16.957598 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-16e68b90-5847-4ed3-a358-7b2437316133 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.059934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:17.099472 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-39daaf05-f512-4ea3-9234-509237168300 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1297 microversion: 2.1 time: 0.291927 Sep 24 19:47:17.104558 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 170/311] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:16 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1297 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:17.131294 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:17.132175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:17.134886 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-16e68b90-5847-4ed3-a358-7b2437316133 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Going to try to stop instance {{(pid=127046) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 19:47:17.147559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.149234 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.150784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.153189 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.155060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.157424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.211989 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-16e68b90-5847-4ed3-a358-7b2437316133 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action" status: 202 len: 0 microversion: 2.1 time: 0.266282 Sep 24 19:47:17.219031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 142/312] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:47:16 2022] POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 19:47:17.231086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:17.233044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:17.239773 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.240269 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.241021 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.242051 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.242992 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.243627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.471681 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:17.485460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:17.487339 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:17.489479 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fddda69b-93c0-4a3e-961f-756ba3fd5102 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.379259 Sep 24 19:47:17.490334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 171/313] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:17 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:17.495400 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:17.496733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:17.503643 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.504504 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.505162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.506112 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.507288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.507879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.593084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:17.607138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-91408603-b8c0-4447-a497-81b12d276c8e tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1358 microversion: 2.1 time: 0.386469 Sep 24 19:47:17.607766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 143/314] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:17 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:17.728974 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:17.740216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1daf6e39-4fb0-4914-a86f-e10e44305b94 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.248525 Sep 24 19:47:17.741324 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 172/315] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:17 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:17.838239 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:17.839312 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:17.847774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.848477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.849143 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:17.850009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:17.850618 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:17.851490 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.002024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.010563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7f1bd4e0-c598-4af9-94c0-dc704a33d42d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.186005 Sep 24 19:47:18.011167 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 144/316] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:17 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:18.146271 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:18.146889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:18.155362 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.155871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.156366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.157095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.157557 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.158044 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.234400 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.242183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0a713b15-24a6-43f6-8a8a-962b5dc14263 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1297 microversion: 2.1 time: 0.100114 Sep 24 19:47:18.242753 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 173/317] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:18 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:18.518108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:18.518870 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:18.525076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.525571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.526068 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.527530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.528093 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.528553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.637287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:18.638153 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:18.644534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.645128 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.645671 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.646458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.646997 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.647532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.671947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.680129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.681599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.683135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ddbfa4fd-2ebd-4d3f-a13b-0fbccadd0e09 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.168586 Sep 24 19:47:18.684196 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 145/318] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:18 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:18.764962 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:18.765579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:18.771796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.772218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.772657 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.773357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.773816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.774268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.794104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.802354 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8b2c6b98-3b4e-46d5-b9e4-c6789c41bc88 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1547 microversion: 2.1 time: 0.173936 Sep 24 19:47:18.802929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 174/319] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:18 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:18.827360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:18.828260 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:18.835103 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.835918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.836474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.837227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:18.837840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:18.838455 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:18.923168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.933065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-91cd0613-0ae2-4f82-a4ac-3d52a32345ed tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.171732 Sep 24 19:47:18.933921 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 146/320] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:18 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:18.985914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:18.994492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b6ef51bc-71c5-49de-ad95-5ad11d8454b7 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1547 microversion: 2.1 time: 0.172300 Sep 24 19:47:18.996050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 175/321] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:18 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:19.004864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-566686840", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "networks": [{"uuid": "7c249092-b446-4c04-b1e1-abfb33c1e7df"}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:19.016731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:19.021715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:19.022566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Searching by: {'deleted': False, 'project_id': '8cb38d1aae344b868976df799b74b0f5'} {{(pid=127045) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 19:47:19.030043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.030533 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.030973 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.031735 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.032347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.032782 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.064218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] validate_networks() for [('7c249092-b446-4c04-b1e1-abfb33c1e7df', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:47:19.128701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.multi_cell_list [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 19:47:19.250525 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2651a948-3c67-4e47-8948-2a3cbc2924f5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.236519 Sep 24 19:47:19.251086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 176/322] 10.222.0.55 () {58 vars in 1125 bytes} [Sat Sep 24 19:47:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:47:19.257518 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:19.258233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:19.266016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.266669 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.267319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.268130 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.268603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.269049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.429096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:19.440985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2fdaf4f4-7c94-431b-8d1e-c21bf47c460c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.189009 Sep 24 19:47:19.441573 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 177/323] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:19 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:19.446212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:19.446839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:19.458760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.458760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.458760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.458760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.459219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.459219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.486578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:47:19.487012 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:47:19.487574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:47:19.488028 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:47:19.488645 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:47:19.498798 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.499677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.500279 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.501231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.501884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.502482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.522730 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Getting quotas for project da8284d3beaa421e893bd04ba33081ea. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:47:19.528488 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Getting quotas for user 7d6386b432054b0d9c9e347ec8847462 and project da8284d3beaa421e893bd04ba33081ea. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:47:19.545664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:47:19.549409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:47:19.601009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6ef42318-ed3b-43c5-928e-eb29a814cac1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600024 Sep 24 19:47:19.602135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 147/324] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:47:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:47:19.607970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:19.608930 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:19.618961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.619743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.620687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.621572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.622195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.622796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.664051 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:19.679719 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ba7575da-fa99-4a0e-95cc-e1e993cade9d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1547 microversion: 2.1 time: 0.237030 Sep 24 19:47:19.680303 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 178/325] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:19 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1547 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:19.713648 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-159118e6-94a2-4974-bcc1-10a248dbbb59 req-14eb4379-c453-4b29-b806-6a299035aeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff9117a-11ce-4612-9153-8356567961ef", "name": "network-vif-plugged", "status": "completed", "tag": "2a1ece25-0e03-454a-b128-725cca130281"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:19.727800 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-159118e6-94a2-4974-bcc1-10a248dbbb59 req-14eb4379-c453-4b29-b806-6a299035aeba service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.728637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-159118e6-94a2-4974-bcc1-10a248dbbb59 req-14eb4379-c453-4b29-b806-6a299035aeba service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.730536 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-159118e6-94a2-4974-bcc1-10a248dbbb59 req-14eb4379-c453-4b29-b806-6a299035aeba service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.749206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-159118e6-94a2-4974-bcc1-10a248dbbb59 req-14eb4379-c453-4b29-b806-6a299035aeba service nova] Creating event network-vif-plugged:2a1ece25-0e03-454a-b128-725cca130281 for instance 3ff9117a-11ce-4612-9153-8356567961ef on hv-cinder-85919 Sep 24 19:47:19.756470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-159118e6-94a2-4974-bcc1-10a248dbbb59 req-14eb4379-c453-4b29-b806-6a299035aeba service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061814 Sep 24 19:47:19.757938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 179/326] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:19.768503 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-330e6b25-fdc9-4053-9dd6-8ab0a1c3bdfe tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:19.769491 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-330e6b25-fdc9-4053-9dd6-8ab0a1c3bdfe tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:19.777547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:19.787380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5548a080-a74e-40bc-9b70-9240b3c1c79c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1305 microversion: 2.1 time: 0.183749 Sep 24 19:47:19.800834 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 148/327] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:19 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1305 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:19.811768 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:19.812388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:19.819596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.820352 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.821799 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.822709 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.823655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.824721 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.887114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-330e6b25-fdc9-4053-9dd6-8ab0a1c3bdfe tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:19.898057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-330e6b25-fdc9-4053-9dd6-8ab0a1c3bdfe tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1213 microversion: 2.1 time: 0.138506 Sep 24 19:47:19.900352 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 180/328] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:19 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:19.964550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:19.965407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:19.981729 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.985578 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.985998 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:19.986973 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:19.987605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:19.992131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:20.064875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:20.087298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:20.090284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:20.092443 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a141f02e-a6b9-4516-be18-7bea8b278e1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.290513 Sep 24 19:47:20.093023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 149/329] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:19 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:20.325201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:20.341096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0fffda1d-94c4-4321-8d0f-d33799276b61 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.383617 Sep 24 19:47:20.355192 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 181/330] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:19 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:20.464525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:20.465142 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:20.471496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:20.472236 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:20.472677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:20.473388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:20.473852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:20.474374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:20.624867 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:20.627189 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:20.634830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5f966912-2876-4323-a26d-aa1e5bae0c0d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.174403 Sep 24 19:47:20.641133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 150/331] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:20 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:20.816552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:20.817327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:20.825377 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:20.825876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:20.826628 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:20.827368 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:20.828224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:20.828394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:20.925164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:20.925915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:20.936052 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:20.936558 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:20.937004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:20.937888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:20.938575 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:20.939364 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.019743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:21.030014 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4714121b-c201-42d7-889a-420bf237a066 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1209 microversion: 2.1 time: 0.109710 Sep 24 19:47:21.030624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 151/332] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:20 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:21.059761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:21.070663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-60ae504b-10c0-4af5-875b-dc468b3df99e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.259073 Sep 24 19:47:21.071737 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 182/333] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:20 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:21.119733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:21.120464 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:21.127204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.127738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.128470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.129153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.129623 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.130055 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.277662 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:21.286424 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:21.287983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:21.289164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3bc96e04-f004-484b-a71b-6010b43d0fe6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.173857 Sep 24 19:47:21.289748 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 152/334] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:21 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:21.377045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:21.377865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:21.386889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.387392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.387874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.388586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.389118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.389480 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.565572 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:21.575780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4b5b258e-b7a9-47e0-8531-5eb0ffb15241 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.202850 Sep 24 19:47:21.576449 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 183/335] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:21 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:21.634904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07085d30-a2e7-4023-895d-3abd72f2f2eb"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:21.638060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:21.644496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.644993 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.645432 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.646362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.647071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.647560 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.658744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:21.659399 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:21.666738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.668402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.669029 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.670188 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:21.676154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:21.676688 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:21.910801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:21.919692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fc8a2844-f9a4-4445-b57d-ec6bdf0dfa98 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1365 microversion: 2.1 time: 0.264478 Sep 24 19:47:21.920311 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 184/336] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:21 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:22.056899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:22.058221 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:22.065583 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.066158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.066869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.067782 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.068419 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.068993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.148210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:22.150568 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:22.157829 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4d7369e6-1edc-4780-97bb-242770de61ac tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1265 microversion: 2.1 time: 0.104866 Sep 24 19:47:22.158477 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 185/337] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:22 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:22.163541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:22.164108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:22.170879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.171378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.171838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.172544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.172999 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.173424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.367796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:22.376317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-52f5b4b1-21e5-4c50-be7f-7beb2e0726ea tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.216771 Sep 24 19:47:22.376900 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 186/338] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:22 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:22.382091 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:22.382798 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:22.397025 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.397539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.397982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.398901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.399373 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.402532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.587972 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:22.597147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:22.598617 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:22.599796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5ead588e-13db-4fcf-9893-623796cb7374 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.221952 Sep 24 19:47:22.600347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 187/339] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:22 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:22.605278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-b3df9305-c648-4fef-836d-4e5c2e320813 req-63584c02-30ef-4a1a-8556-d9d3f71d8ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81c1923-5243-4247-aee6-805f902927ca", "tag": "844ee860-c3c3-460e-87aa-ab602ef8bf67"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:22.614824 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b3df9305-c648-4fef-836d-4e5c2e320813 req-63584c02-30ef-4a1a-8556-d9d3f71d8ca2 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.615291 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b3df9305-c648-4fef-836d-4e5c2e320813 req-63584c02-30ef-4a1a-8556-d9d3f71d8ca2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.615752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b3df9305-c648-4fef-836d-4e5c2e320813 req-63584c02-30ef-4a1a-8556-d9d3f71d8ca2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.626642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-b3df9305-c648-4fef-836d-4e5c2e320813 req-63584c02-30ef-4a1a-8556-d9d3f71d8ca2 service nova] Creating event network-changed:844ee860-c3c3-460e-87aa-ab602ef8bf67 for instance f81c1923-5243-4247-aee6-805f902927ca on hv-cinder-85919 Sep 24 19:47:22.631441 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-b3df9305-c648-4fef-836d-4e5c2e320813 req-63584c02-30ef-4a1a-8556-d9d3f71d8ca2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029979 Sep 24 19:47:22.632035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 188/340] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:22.637970 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:22.638687 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:22.646733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.646733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.647127 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.648154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.648633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.649096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.790240 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:22.799990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-dc1a6612-035c-4a6a-bac1-9c5fdda30a08 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.166574 Sep 24 19:47:22.800587 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 189/341] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:22 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:22.945686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:22.946210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:22.962772 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.963287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.964359 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:22.965093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:22.965559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:22.968500 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.139052 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2f8dd9e1-c776-4ea2-b53b-756579c6f855 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.508276 Sep 24 19:47:23.140772 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 153/342] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:47:21 2022] POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments => generated 194 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:23.184137 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:23.184884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:23.191896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.192302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.192751 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.193470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.193939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.194343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.265273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:23.280325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-840db79c-d81f-44e1-89cb-1bf8f6260d93 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1556 microversion: 2.1 time: 0.340669 Sep 24 19:47:23.281361 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 190/343] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:22 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1556 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:23.287106 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:23.296241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-068de703-2b80-42ad-94f6-c65733c013ca tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1265 microversion: 2.1 time: 0.117461 Sep 24 19:47:23.296901 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 154/344] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:23 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:23.305750 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:23.307136 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:23.320708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.320708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.320708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.321274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.321912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.322417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.402910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:23.403989 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:23.414282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.415020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.415772 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.416939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.417727 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.418493 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.431734 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-075ed782-0ed4-4d9d-aa74-55d2cb039f4c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129272 Sep 24 19:47:23.433790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 191/345] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:47:23 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:23.627049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:23.627701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:23.634165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.634659 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.635095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.635929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.636401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.636818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.840328 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:23.850216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:23.851928 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:23.853394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e82daf57-ac32-46f1-b824-5151d23b60de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.230366 Sep 24 19:47:23.854132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 192/346] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:23 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:47:23.860504 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:23.861429 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:23.868356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.869024 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.869629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:23.871418 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:23.872094 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:23.872714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:24.033561 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:24.041854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c8fc023b-fa91-418b-923a-a732c578a805 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.185555 Sep 24 19:47:24.043344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 193/347] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:23 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:24.078937 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:24.087930 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1d43b69a-6dfb-4b8d-acdc-e3cb9573b9ee tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.692469 Sep 24 19:47:24.088516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 155/348] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:23 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:24.321054 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:24.321671 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:24.328546 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:24.328962 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:24.329399 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:24.330102 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:24.330555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:24.330977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:24.396373 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:24.405313 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9b9c681b-ab26-4a07-b46d-370216367fdf tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1283 microversion: 2.1 time: 0.088039 Sep 24 19:47:24.405916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 194/349] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:24 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:24.875684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-e897919f-3a15-4c38-b2f4-29683271f523 req-4565bea0-b2f0-4eda-b922-0ceb03dbf6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff9117a-11ce-4612-9153-8356567961ef", "tag": "2a1ece25-0e03-454a-b128-725cca130281"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:24.882066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:24.882793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:24.890307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:24.891134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:24.892230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:24.893038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:24.893710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:24.894144 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:24.897008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e897919f-3a15-4c38-b2f4-29683271f523 req-4565bea0-b2f0-4eda-b922-0ceb03dbf6f5 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:24.897622 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e897919f-3a15-4c38-b2f4-29683271f523 req-4565bea0-b2f0-4eda-b922-0ceb03dbf6f5 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:24.898161 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e897919f-3a15-4c38-b2f4-29683271f523 req-4565bea0-b2f0-4eda-b922-0ceb03dbf6f5 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:24.911294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-e897919f-3a15-4c38-b2f4-29683271f523 req-4565bea0-b2f0-4eda-b922-0ceb03dbf6f5 service nova] Creating event network-changed:2a1ece25-0e03-454a-b128-725cca130281 for instance 3ff9117a-11ce-4612-9153-8356567961ef on hv-cinder-85919 Sep 24 19:47:24.916376 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-e897919f-3a15-4c38-b2f4-29683271f523 req-4565bea0-b2f0-4eda-b922-0ceb03dbf6f5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044451 Sep 24 19:47:24.917320 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 156/350] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:25.032344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:25.040713 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:25.043136 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:25.044655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8f961da2-90d0-4e27-87a6-6a43039c9fba tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.166298 Sep 24 19:47:25.045233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 195/351] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:24 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:47:25.067004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:25.068196 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:25.075353 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:25.075882 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:25.076324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:25.077032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:25.077494 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:25.077952 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:25.113919 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:25.114706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:25.121440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:25.122703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:25.124473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:25.125232 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:25.134462 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:25.135001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:25.403889 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:25.414769 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bf0be89e-4a20-42b8-93c9-96d9d28eceb9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.352616 Sep 24 19:47:25.416019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 157/352] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:25 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:25.435990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:25.443215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:25.452590 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:25.453775 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:25.454694 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:25.455855 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:25.456478 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:25.457061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:25.466439 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:25.475559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d7a5c7ed-9ff3-4958-b89e-474dfb5eecae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.367512 Sep 24 19:47:25.492538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 196/353] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:25 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:25.618437 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:25.629230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-03114b26-723c-42ea-a64c-db57a9bb14bb tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1271 microversion: 2.1 time: 0.204771 Sep 24 19:47:25.629832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 158/354] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:25 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:26.071333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:26.071992 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:26.083254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.083805 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.084254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.084984 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.085452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.085884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.290261 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:26.304897 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:26.313923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:26.320204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b10f3316-2d7f-4544-9597-376f2c182c89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.252974 Sep 24 19:47:26.320809 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 197/355] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:26 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:26.445514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:26.446179 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:26.453908 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.454403 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.454838 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.455574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.456033 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.456464 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.502738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:26.503365 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:26.505438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:26.527521 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.528043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.528490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.529221 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.529691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.530133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.654886 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:26.665713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f7de6714-85ba-4f20-ab0a-1c233ae8fea0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.228615 Sep 24 19:47:26.666473 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 159/356] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:26 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:26.672273 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:26.672990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:26.679921 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.680725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.681627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.682991 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:26.683586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:26.684243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:26.684694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:26.694993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1153e872-e72b-4131-bde9-6bffa48c8abd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.197368 Sep 24 19:47:26.695862 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 198/357] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:26 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:26.946028 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:26.954383 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9732b17a-5f36-4187-a2c8-c0f8609923e3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.286066 Sep 24 19:47:26.954965 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 160/358] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:26 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:27.349228 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:27.349839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:27.357348 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.357842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.358280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.359238 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.359754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.360197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.506912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:27.517037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:27.518506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:27.519754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-efd900d9-c0a2-4774-8195-806dfc3cc993 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1745 microversion: 2.20 time: 0.174563 Sep 24 19:47:27.520320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 199/359] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:27 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:27.593031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-88d343d5-5844-49b5-8cc2-c061a1214a78 req-b463f08c-19f9-464e-a0e7-a79c0e8492ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f0fca6-b1aa-497c-8198-261ebe0ad34b", "tag": "09e82c89-b7ed-46fb-8efe-c8adc398e0d6"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:27.604066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-88d343d5-5844-49b5-8cc2-c061a1214a78 req-b463f08c-19f9-464e-a0e7-a79c0e8492ab service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.604066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-88d343d5-5844-49b5-8cc2-c061a1214a78 req-b463f08c-19f9-464e-a0e7-a79c0e8492ab service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.604661 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-88d343d5-5844-49b5-8cc2-c061a1214a78 req-b463f08c-19f9-464e-a0e7-a79c0e8492ab service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.617876 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-88d343d5-5844-49b5-8cc2-c061a1214a78 req-b463f08c-19f9-464e-a0e7-a79c0e8492ab service nova] Creating event network-changed:09e82c89-b7ed-46fb-8efe-c8adc398e0d6 for instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b on hv-cinder-85919 Sep 24 19:47:27.623501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-88d343d5-5844-49b5-8cc2-c061a1214a78 req-b463f08c-19f9-464e-a0e7-a79c0e8492ab service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034703 Sep 24 19:47:27.624316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 161/360] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:27.692993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:27.693927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:27.700791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.701197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.701638 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.702358 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.702825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.703257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.720416 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:27.721395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:27.727999 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.728491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.728926 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.729668 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.730319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.730751 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.873296 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:27.890723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-994ede8e-1c5a-4465-9417-6044f628f7de tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.201517 Sep 24 19:47:27.891990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 200/361] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:27 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:27.972997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:27.978576 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:27.979730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:27.983883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4f652488-1752-4d22-ad8c-28cd430d2922 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.268131 Sep 24 19:47:27.985155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 162/362] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:27 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:27.985975 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.986469 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.986903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:27.991277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:27.991277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:27.991277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:28.146991 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:28.155676 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9f7883b2-9fba-4ff5-afcf-c6ed8d35262c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.181307 Sep 24 19:47:28.156252 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 201/363] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:27 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:28.547321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:28.548200 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:28.554598 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:28.555178 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:28.555733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:28.556502 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:28.556966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:28.557439 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:28.694157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:28.702545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:28.704085 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:28.705253 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-68bbdd8e-5b81-42b3-90bd-a28533701656 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1745 microversion: 2.20 time: 0.162143 Sep 24 19:47:28.705839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 163/364] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:28 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:28.914869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:28.915548 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:28.922709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:28.923207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:28.923684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:28.924404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:28.924874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:28.925304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.007398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:29.008113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:29.014734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:29.015229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:29.015705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.016413 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:29.016878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:29.017311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.060097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:29.070474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:29.074690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f15c8e49-83fc-4e4e-a3e6-0bcd2af8d9db tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.163501 Sep 24 19:47:29.075478 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 202/365] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:28 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:29.156999 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:29.164821 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1b04b2c7-3446-451b-af7c-2ac686a704db tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.161490 Sep 24 19:47:29.165403 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 164/366] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:29 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:29.178718 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:29.179531 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:29.186280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:29.186781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:29.187227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.187983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:29.188448 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:29.188877 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.204697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:29.327334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:29.336194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c2e5b42e-2a01-4454-aa8c-9c06354a5f82 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.161369 Sep 24 19:47:29.336796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 203/367] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:29 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:29.350195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-e7d0a4a1-3212-47cf-a3e3-6a942060d2c5 req-2d439193-42c5-47dd-8c32-c83780a9955a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f81c1923-5243-4247-aee6-805f902927ca", "name": "network-vif-plugged", "status": "completed", "tag": "844ee860-c3c3-460e-87aa-ab602ef8bf67"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:29.361458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e7d0a4a1-3212-47cf-a3e3-6a942060d2c5 req-2d439193-42c5-47dd-8c32-c83780a9955a service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:29.362042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e7d0a4a1-3212-47cf-a3e3-6a942060d2c5 req-2d439193-42c5-47dd-8c32-c83780a9955a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:29.362508 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e7d0a4a1-3212-47cf-a3e3-6a942060d2c5 req-2d439193-42c5-47dd-8c32-c83780a9955a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.375210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-e7d0a4a1-3212-47cf-a3e3-6a942060d2c5 req-2d439193-42c5-47dd-8c32-c83780a9955a service nova] Creating event network-vif-plugged:844ee860-c3c3-460e-87aa-ab602ef8bf67 for instance f81c1923-5243-4247-aee6-805f902927ca on hv-cinder-85919 Sep 24 19:47:29.380158 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-e7d0a4a1-3212-47cf-a3e3-6a942060d2c5 req-2d439193-42c5-47dd-8c32-c83780a9955a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033677 Sep 24 19:47:29.380750 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 165/368] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:47:29.730735 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:29.731350 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:29.737636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:29.738129 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:29.738568 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.739272 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:29.739773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:29.740207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:29.876509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:29.886055 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:29.887740 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:29.888993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c12ecacc-8ff2-42d2-8cf0-1abb14c0dda5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1745 microversion: 2.20 time: 0.162737 Sep 24 19:47:29.889728 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 204/369] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:29 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:30.098904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:30.099686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:30.101626 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=4 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:30.102294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=20 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:30.110036 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.110529 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.110969 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:30.111696 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.112208 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.112640 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:30.188778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:30.189491 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:30.191461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=4 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:30.197593 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.198286 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.198736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:30.199466 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.199932 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.200364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:30.293310 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:30.302416 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5d07db19-8104-4a80-8731-8838aeffa602 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.207764 Sep 24 19:47:30.303008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 166/370] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:30 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:30.341493 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:30.349122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-17fe61b0-47f3-4ee0-9788-b21b6fde0e09 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.164586 Sep 24 19:47:30.349693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 205/371] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:30 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:30.361670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:30.362655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:30.369602 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.370175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.370774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:30.371532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.372006 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.372444 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:30.502853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:30.511086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-75ed1ea7-385a-4940-8336-ff9a4602ad5f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.153306 Sep 24 19:47:30.511670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 167/372] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:30 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:30.915326 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:30.915977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:30.922476 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.922969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.923413 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:30.924140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:30.924605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:30.925036 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:31.055615 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:31.064569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:31.066033 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:31.067201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a0d97b66-384f-430e-a421-32c7479b3cb4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1745 microversion: 2.20 time: 0.155802 Sep 24 19:47:31.067797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 206/373] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:30 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:31.326289 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:31.327046 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:31.333718 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:31.334220 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:31.334666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:31.335378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:31.335871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:31.336306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:31.341245 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:31.381187 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:31.381819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:31.388879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:31.389388 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:31.389837 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:31.390562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:31.391046 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:31.391487 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:31.491048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:31.504096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-14f18115-1c70-48be-895e-792a5533f910 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.180985 Sep 24 19:47:31.505379 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 168/374] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:31 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:31.534839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:31.535784 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:31.542253 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:31.543213 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:31.543893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:31.544881 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:31.545513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:31.546109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:31.552420 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:31.563282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-68ab12f1-0984-44c3-a0a7-a57c00789562 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1371 microversion: 2.1 time: 0.194567 Sep 24 19:47:31.563895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 207/375] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:31 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:31.693686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:31.704439 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a7cdb8c4-ca7f-43c0-8b7e-6f3e08b75ed8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.173438 Sep 24 19:47:31.705684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 169/376] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:31 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:32.093060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:32.093674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:32.099727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.100218 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.100693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.101397 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.101859 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.102289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.236041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:32.244386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:32.246487 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:32.247750 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c7e4ff3e-029f-4ff6-8d75-ec74cead7be6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.158678 Sep 24 19:47:32.248336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 208/377] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:32 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:32.532634 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:32.533290 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:32.539500 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.539934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.540376 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.541106 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.542284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.542724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.594109 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:32.594836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:32.601220 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.601888 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.602416 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.603323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.603969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.605085 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.674854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:32.683185 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d68e2252-e247-4652-a513-fee07961b3ca tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.154518 Sep 24 19:47:32.684163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 170/378] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:32 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:32.727712 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:32.728465 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:32.735781 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.736383 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.736905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.737879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.738418 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.738922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.748250 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:32.756180 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e911723f-26dc-441d-8b7b-982f6712b1b1 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1564 microversion: 2.1 time: 0.166550 Sep 24 19:47:32.756754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 209/379] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:32 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:32.779898 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:32.780353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:32.786703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.787639 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.788270 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.788977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:32.789441 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:32.789930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:32.874157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-382c2197-24bd-4a51-9225-12db80b0456b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098483 Sep 24 19:47:32.874852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 210/380] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:47:32 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:32.883080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:32.891580 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-54b91d3b-b853-40fa-a497-3403b27be65d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.167993 Sep 24 19:47:32.892150 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 171/381] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:32 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:33.274474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:33.275222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:33.281414 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:33.281925 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:33.282356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:33.283071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:33.283560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:33.283991 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:33.422147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:33.431514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:33.433994 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:33.435214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4f01b742-8b21-47d9-971f-64ee2647a946 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.164868 Sep 24 19:47:33.435981 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 211/382] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:33 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:47:33.706011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:33.706800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:33.713507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:33.714245 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:33.714778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:33.715658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:33.716193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:33.716697 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:33.921843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-d16b3458-cf8f-4441-95ea-fc0778ff9d70 req-ddfeb77d-eef4-40b6-868b-851c7c7d5316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81c1923-5243-4247-aee6-805f902927ca", "tag": "844ee860-c3c3-460e-87aa-ab602ef8bf67"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:33.951012 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d16b3458-cf8f-4441-95ea-fc0778ff9d70 req-ddfeb77d-eef4-40b6-868b-851c7c7d5316 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:33.953353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d16b3458-cf8f-4441-95ea-fc0778ff9d70 req-ddfeb77d-eef4-40b6-868b-851c7c7d5316 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:33.953927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:33.955278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d16b3458-cf8f-4441-95ea-fc0778ff9d70 req-ddfeb77d-eef4-40b6-868b-851c7c7d5316 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:33.966173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-20534d5f-7723-474f-95d1-8ca8de70308d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.263800 Sep 24 19:47:33.971624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-d16b3458-cf8f-4441-95ea-fc0778ff9d70 req-ddfeb77d-eef4-40b6-868b-851c7c7d5316 service nova] Creating event network-changed:844ee860-c3c3-460e-87aa-ab602ef8bf67 for instance f81c1923-5243-4247-aee6-805f902927ca on hv-cinder-85919 Sep 24 19:47:33.977694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-d16b3458-cf8f-4441-95ea-fc0778ff9d70 req-ddfeb77d-eef4-40b6-868b-851c7c7d5316 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073960 Sep 24 19:47:33.987930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 212/383] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:33.988022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 172/384] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:33 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:33.988110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:33.988530 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:33.995506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:33.996095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:33.996636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:33.997370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:33.997843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:33.998275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:34.070881 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:34.071944 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:34.083009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:34.083742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:34.084289 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:34.085176 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:34.085800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:34.087145 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:34.181382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:34.196967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a8ee6943-4fed-4f5e-a993-eb5687fc5203 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.212611 Sep 24 19:47:34.197613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 213/385] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:33 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:34.462852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:34.464010 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:34.470551 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:34.471360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:34.472071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:34.473006 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:34.473672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:34.474301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:34.607131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:34.619151 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d8eac64f-858e-4e1f-abc5-df34dd12efd4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1593 microversion: 2.1 time: 0.552590 Sep 24 19:47:34.619817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 173/386] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:34 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1593 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:34.695497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:34.706606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:34.709044 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:34.711983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c41525a4-74b9-4507-bf24-55a9cb3a8a5e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.253388 Sep 24 19:47:34.732515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 214/387] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:34 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:34.895560 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-e69b1d6a-e7cf-476d-929f-c54b745fac66 req-ffeca60c-fb09-4022-aa84-affd02f5cef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f0fca6-b1aa-497c-8198-261ebe0ad34b", "name": "network-vif-plugged", "status": "completed", "tag": "09e82c89-b7ed-46fb-8efe-c8adc398e0d6"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:34.915866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e69b1d6a-e7cf-476d-929f-c54b745fac66 req-ffeca60c-fb09-4022-aa84-affd02f5cef2 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:34.916886 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e69b1d6a-e7cf-476d-929f-c54b745fac66 req-ffeca60c-fb09-4022-aa84-affd02f5cef2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:34.917532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-e69b1d6a-e7cf-476d-929f-c54b745fac66 req-ffeca60c-fb09-4022-aa84-affd02f5cef2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:34.931016 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-e69b1d6a-e7cf-476d-929f-c54b745fac66 req-ffeca60c-fb09-4022-aa84-affd02f5cef2 service nova] Creating event network-vif-plugged:09e82c89-b7ed-46fb-8efe-c8adc398e0d6 for instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b on hv-cinder-85919 Sep 24 19:47:34.938380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-e69b1d6a-e7cf-476d-929f-c54b745fac66 req-ffeca60c-fb09-4022-aa84-affd02f5cef2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047305 Sep 24 19:47:34.939680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 174/388] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:34.990705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:34.991236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:35.018845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:35.027674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:35.030644 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:35.034322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:35.036493 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:35.038929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:35.223107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:35.224122 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:35.243873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:35.246828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:35.247519 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:35.251135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:35.252537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:35.256290 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:35.426701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:35.451166 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4fafd03b-c66b-400f-8c8f-eaa8ab9f01f4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.464903 Sep 24 19:47:35.454603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 215/389] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:34 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:35.739937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:35.740564 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:35.754470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:35.754936 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:35.755392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:35.756163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:35.761441 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:35.762190 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:35.851328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:35.863853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-adba0885-8af0-4519-980b-2e5e1b3996a8 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.645958 Sep 24 19:47:35.865132 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 175/390] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:35 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:36.113773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:36.124134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:36.125605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:36.126816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ced6f940-efc2-4c7b-8b31-4677b8eefd28 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.392564 Sep 24 19:47:36.143447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 216/391] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:35 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:36.490013 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:36.491205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:36.491474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2141919108", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1495379635", "security_groups": [{"name": "tempest-secgroup-smoke-1657694783"}], "networks": [{"uuid": "441d66a8-6f09-450b-9a3e-fe6fc796660b"}], "block_device_mapping_v2": [{"uuid": "b40397d4-373e-4224-b9b9-09245455b168", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:36.502104 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:36.502618 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:36.503063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:36.504222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:36.504924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:36.505531 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:36.697777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] validate_networks() for [('441d66a8-6f09-450b-9a3e-fe6fc796660b', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:47:36.758581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:36.769224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c26d5792-c2ba-4b1e-973e-c451f62682ab tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.294152 Sep 24 19:47:36.770527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 176/392] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:36 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:36.888318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:36.889334 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:36.903410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:36.904927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:36.905480 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:36.906609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:36.907162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:36.907695 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.085081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:37.093858 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d0739481-b678-41a8-aa48-2e596558ba14 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1313 microversion: 2.1 time: 0.209781 Sep 24 19:47:37.094731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 177/393] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:36 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:37.100092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-12eb9785-9469-4eac-bb06-f4fbb245ba93 req-4ccb4c09-f8c1-436d-a7e3-80641798dfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff567a7-861e-469a-913d-add40f3220c9", "name": "network-vif-plugged", "status": "completed", "tag": "8874d4a7-638a-44b3-b521-fda12ba4f441"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:37.116103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-12eb9785-9469-4eac-bb06-f4fbb245ba93 req-4ccb4c09-f8c1-436d-a7e3-80641798dfc4 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.116716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-12eb9785-9469-4eac-bb06-f4fbb245ba93 req-4ccb4c09-f8c1-436d-a7e3-80641798dfc4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.117724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-12eb9785-9469-4eac-bb06-f4fbb245ba93 req-4ccb4c09-f8c1-436d-a7e3-80641798dfc4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.131142 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-12eb9785-9469-4eac-bb06-f4fbb245ba93 req-4ccb4c09-f8c1-436d-a7e3-80641798dfc4 service nova] Creating event network-vif-plugged:8874d4a7-638a-44b3-b521-fda12ba4f441 for instance bff567a7-861e-469a-913d-add40f3220c9 on hv-cinder-85919 Sep 24 19:47:37.142533 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-12eb9785-9469-4eac-bb06-f4fbb245ba93 req-4ccb4c09-f8c1-436d-a7e3-80641798dfc4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046260 Sep 24 19:47:37.147186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 178/394] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:37.156808 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:37.157673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:37.175306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.180531 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.181145 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.182550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.183336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.183729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.410947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:37.421922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:37.423555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:37.424828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-10ee9c12-2446-422e-96e2-4edad36b9238 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.272300 Sep 24 19:47:37.425802 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 179/395] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:37 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:37.555929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:47:37.556474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:47:37.557011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:47:37.558545 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:47:37.558993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:47:37.573317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.574111 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.574741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.575514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.576153 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.576762 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.608118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Getting quotas for project f5c3250304054594abbaa610e49da216. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:47:37.612855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Getting quotas for user e6cc144c0d804a84a8d35eaa57fab6bb and project f5c3250304054594abbaa610e49da216. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:47:37.688550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:47:37.690706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b40397d4-373e-4224-b9b9-09245455b168',volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:47:37.786377 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-9810600e-cbd5-4d54-94cb-582829e29ffb req-73ad0511-1f3f-438c-8626-300f959f4a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241", "tag": "df4d7c5e-93cd-42b9-998b-7c78ab449dc1"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:37.812235 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9810600e-cbd5-4d54-94cb-582829e29ffb req-73ad0511-1f3f-438c-8626-300f959f4a19 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.814995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9810600e-cbd5-4d54-94cb-582829e29ffb req-73ad0511-1f3f-438c-8626-300f959f4a19 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.816373 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9810600e-cbd5-4d54-94cb-582829e29ffb req-73ad0511-1f3f-438c-8626-300f959f4a19 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.842759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-9810600e-cbd5-4d54-94cb-582829e29ffb req-73ad0511-1f3f-438c-8626-300f959f4a19 service nova] Creating event network-changed:df4d7c5e-93cd-42b9-998b-7c78ab449dc1 for instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 on hv-cinder-85919 Sep 24 19:47:37.850061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-9810600e-cbd5-4d54-94cb-582829e29ffb req-73ad0511-1f3f-438c-8626-300f959f4a19 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071944 Sep 24 19:47:37.851331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 180/396] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:37.858854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:37.859850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:37.865651 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:37.868570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.871004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.872001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:37.873622 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:37.874434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:37.875758 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:38.045253 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f2f6449e-d59a-4fdc-a555-f568f32bf774 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.558850 Sep 24 19:47:38.046645 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 217/397] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:47:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 19:47:38.068244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4cd1d24f-a54e-40ee-be48-ea4263763c28 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:38.074039 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4cd1d24f-a54e-40ee-be48-ea4263763c28 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:38.214723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4cd1d24f-a54e-40ee-be48-ea4263763c28 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:38.222914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4cd1d24f-a54e-40ee-be48-ea4263763c28 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1089 microversion: 2.1 time: 0.168683 Sep 24 19:47:38.223509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 218/398] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:38 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1089 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:38.232015 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:38.239473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:38.255048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:38.255838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:38.256290 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:38.257002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:38.257481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:38.257889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:38.527863 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:38.540570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9f0dbb83-8265-4faf-b330-4109702366b9 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1496 microversion: 2.1 time: 0.312383 Sep 24 19:47:38.559697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 219/399] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:38 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1496 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:38.569937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:38.570618 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:38.577870 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:38.578378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:38.578817 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:38.579955 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:38.580433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:38.580881 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:38.652295 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:38.667661 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1104029f-140f-415a-a8b7-01e1bbb01de4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1725 microversion: 2.1 time: 0.814613 Sep 24 19:47:38.670253 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 181/400] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:37 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1725 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:38.861213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:38.874852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:38.880560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:38.882384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b25077a8-a1b5-4191-b079-f46476e8b2c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.321534 Sep 24 19:47:38.886378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 220/401] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:38 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:39.246166 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:39.247535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:39.256205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.257117 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.257847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.258816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.259543 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.260941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.392407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:39.393267 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:39.399095 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:39.406147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.410550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.411319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.413011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.413683 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.414871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0402835d-5c5e-4121-a977-77073ebca88a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1131 microversion: 2.1 time: 0.173214 Sep 24 19:47:39.424752 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 182/402] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:39 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1131 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:39.425514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.499410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:47:39.545892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:39.678804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d6641d20-05a6-4fac-bf16-9fe64bced9df tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "DELETE /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 204 len: 0 microversion: 2.1 time: 0.291086 Sep 24 19:47:39.680608 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 221/403] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:47:39 2022] DELETE /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:47:39.690619 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:39.692099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:39.708391 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.709342 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.710610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.711711 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.712361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.712987 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.716733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:39.719187 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:39.729624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.730840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.731565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.732544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:39.733199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:39.733812 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:39.958322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:39.975539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-75753ccf-a529-4461-98ea-ad817df48060 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1702 microversion: 2.1 time: 0.285654 Sep 24 19:47:39.976901 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:39.979575 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 222/404] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:39 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1702 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:39.985301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:39.985550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c3857a36-5388-4c7b-ae5b-f6538153bab3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1502 microversion: 2.1 time: 0.299435 Sep 24 19:47:39.986119 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 183/405] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:39 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:39.996069 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:40.011609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-36314be7-d742-44db-ba71-1c593ca9d859 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:40.014595 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.015506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.015662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.017524 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.019577 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-36314be7-d742-44db-ba71-1c593ca9d859 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.020285 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-36314be7-d742-44db-ba71-1c593ca9d859 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.020431 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.020773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.021199 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-36314be7-d742-44db-ba71-1c593ca9d859 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.057358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-36314be7-d742-44db-ba71-1c593ca9d859 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Going to try to start instance {{(pid=127046) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 19:47:40.160782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-36314be7-d742-44db-ba71-1c593ca9d859 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action" status: 202 len: 0 microversion: 2.1 time: 0.153566 Sep 24 19:47:40.162863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 184/406] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:47:40 2022] POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:47:40.172590 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:40.180064 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:40.188835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.189707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.190314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.191211 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.191917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.192359 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.248015 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:40.259284 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:40.262280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:40.264348 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f49c425e-b19f-4b9f-ab96-ff2ff97771a0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.282780 Sep 24 19:47:40.265320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 223/407] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:39 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:40.406283 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:40.408630 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:40.416657 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4a3f7955-fd5e-4cf4-96b7-534fbc7c8930 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1711 microversion: 2.1 time: 0.249153 Sep 24 19:47:40.417570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 185/408] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:40 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1711 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:40.446009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:40.450560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:40.459270 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.460229 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.460905 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.461957 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.462717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.465657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.571145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:40.579907 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d2c6d565-4942-49fa-94cd-ddcb314bc2dc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1187 microversion: 2.1 time: 0.140628 Sep 24 19:47:40.581383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 224/409] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:40 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1187 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:40.664795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1154829772"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:40.665646 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:40.674251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.675034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.675679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.676400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:40.676865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:40.677294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:40.819783 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.network.security_group_api [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Adding security group 2c8466d7-a1f7-430a-86f6-092d10bac09f to port df4d7c5e-93cd-42b9-998b-7c78ab449dc1 Sep 24 19:47:41.012222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:41.013514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:41.024839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.025854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.026949 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.027967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.028528 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.029198 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.270036 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:41.270870 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b13ea91a-97aa-46d6-9dea-37629acc5ad3 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/action" status: 202 len: 0 microversion: 2.1 time: 0.610363 Sep 24 19:47:41.271617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 186/410] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:47:40 2022] POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:47:41.280578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:41.281233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:41.283768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-dcbbda4b-e75f-4261-a4ae-cd6e0c9f2581 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1502 microversion: 2.1 time: 0.275399 Sep 24 19:47:41.286928 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 225/411] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:41 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:41.298287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:41.299037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:41.306014 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.306640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.308891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.310096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.310317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.310818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.354104 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.357048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.357688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.359849 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.362044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.365670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.571065 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:41.581034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:41.585707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:41.588163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ad34bcd2-9d85-4a70-bf5f-6897fdd1ad13 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.299681 Sep 24 19:47:41.588974 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 226/412] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:41 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:41.594561 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-fdebdd59-d5f4-424d-bb09-8cb94a6194a6 req-ae5d4252-3828-4c75-8ca9-2604f81be804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241", "tag": "df4d7c5e-93cd-42b9-998b-7c78ab449dc1"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:41.606215 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fdebdd59-d5f4-424d-bb09-8cb94a6194a6 req-ae5d4252-3828-4c75-8ca9-2604f81be804 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.606734 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fdebdd59-d5f4-424d-bb09-8cb94a6194a6 req-ae5d4252-3828-4c75-8ca9-2604f81be804 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.607328 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fdebdd59-d5f4-424d-bb09-8cb94a6194a6 req-ae5d4252-3828-4c75-8ca9-2604f81be804 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.631502 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-fdebdd59-d5f4-424d-bb09-8cb94a6194a6 req-ae5d4252-3828-4c75-8ca9-2604f81be804 service nova] Creating event network-changed:df4d7c5e-93cd-42b9-998b-7c78ab449dc1 for instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 on hv-cinder-85919 Sep 24 19:47:41.637716 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-fdebdd59-d5f4-424d-bb09-8cb94a6194a6 req-ae5d4252-3828-4c75-8ca9-2604f81be804 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047323 Sep 24 19:47:41.638584 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 227/413] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:41.643814 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:41.644733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:41.651816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.652565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.653753 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.654752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.655371 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.656078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.689485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:41.704866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3e5940a3-8423-4b35-96e9-c77004935b9f tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1759 microversion: 2.1 time: 0.428145 Sep 24 19:47:41.705522 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 187/414] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:41 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1759 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:41.714848 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:41.717041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:41.730215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.731022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.731683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.732604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:41.733244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:41.733832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:41.934879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:41.955267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0baf182b-b891-4316-9849-ca33f7e2becd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1187 microversion: 2.1 time: 0.248333 Sep 24 19:47:41.955808 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 188/415] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:41 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1187 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:41.970985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:41.981713 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-22c014da-ddd4-4c63-9f5b-4ce8e2c64b9d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1711 microversion: 2.1 time: 0.341778 Sep 24 19:47:41.982630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 228/416] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:41 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1711 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:42.313006 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:42.313720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:42.328007 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:42.341857 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:42.342642 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:42.348155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:42.348733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:42.349684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:42.628009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:42.631114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:42.639981 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:42.641298 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:42.642973 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:42.644111 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:42.644766 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:42.645742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:42.804441 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:42.823870 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6315da33-6fc7-474e-8e6c-aca6717e3629 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1502 microversion: 2.1 time: 0.507493 Sep 24 19:47:42.825228 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 189/417] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:42 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1502 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:42.937323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:42.949813 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:42.954516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:42.956835 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-244cf162-196d-42ed-bcfb-41b08a205b29 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.337713 Sep 24 19:47:42.970311 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 229/418] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:42 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:42.984724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:42.986458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:42.993832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:42.995222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:42.996342 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:42.997333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:42.998003 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:42.998651 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:43.018662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:43.020065 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:43.030759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:43.031255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:43.031726 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:43.032449 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:43.032911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:43.033350 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:43.175339 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:43.188097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-32d133a7-838c-40e3-a0b6-896f08d1168d tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1205 microversion: 2.1 time: 0.206630 Sep 24 19:47:43.193331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 190/419] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:42 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1205 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:43.458009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:43.467340 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-96bda30f-1ed1-4801-aa3e-a24a5b03a0c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1711 microversion: 2.1 time: 0.453151 Sep 24 19:47:43.468188 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 230/420] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:43 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1711 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:43.695805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-bb67972e-4eaf-470d-980e-98fafbec7a7b req-37508e29-7cc1-4d4c-9bf1-146d6d069be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f0fca6-b1aa-497c-8198-261ebe0ad34b", "name": "network-vif-deleted", "tag": "09e82c89-b7ed-46fb-8efe-c8adc398e0d6"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:43.720244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-bb67972e-4eaf-470d-980e-98fafbec7a7b req-37508e29-7cc1-4d4c-9bf1-146d6d069be9 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:43.728141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-bb67972e-4eaf-470d-980e-98fafbec7a7b req-37508e29-7cc1-4d4c-9bf1-146d6d069be9 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:43.729327 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-bb67972e-4eaf-470d-980e-98fafbec7a7b req-37508e29-7cc1-4d4c-9bf1-146d6d069be9 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:43.752560 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-bb67972e-4eaf-470d-980e-98fafbec7a7b req-37508e29-7cc1-4d4c-9bf1-146d6d069be9 service nova] Creating event network-vif-deleted:09e82c89-b7ed-46fb-8efe-c8adc398e0d6 for instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b on hv-cinder-85919 Sep 24 19:47:43.763282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-bb67972e-4eaf-470d-980e-98fafbec7a7b req-37508e29-7cc1-4d4c-9bf1-146d6d069be9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071179 Sep 24 19:47:43.772587 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 191/421] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:43.853330 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:43.857369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:43.890386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:43.893986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:43.894715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:43.897938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:43.898664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:43.899285 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:43.987267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:43.988099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:44.000996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:44.001783 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:44.002385 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:44.003293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:44.003965 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:44.004582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:44.038507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:44.039681 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:44.040946 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:44.042206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lazy-loading 'fault' on Instance uuid 87f0fca6-b1aa-497c-8198-261ebe0ad34b {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:47:44.188639 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:44.200987 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:44.201492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:44.202960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:44.204384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-94793002-6ea0-417f-93be-d4a8fe328d2c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.221906 Sep 24 19:47:44.205800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 192/422] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:43 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:44.219769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b8203761-c6b2-488d-a38a-0965e342e10b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1303 microversion: 2.1 time: 0.374923 Sep 24 19:47:44.221021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 231/423] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:43 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1303 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:44.222026 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:44.222658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:44.231038 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:44.232087 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:44.233069 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:44.234408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:44.235351 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:44.236546 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:44.492222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:44.492854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:44.499697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:44.500205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:44.500654 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:44.501381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:44.501851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:44.502289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:44.669874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:44.683793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9e1241f8-0a1d-4b74-b089-e9a5b28aa48b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1715 microversion: 2.1 time: 0.195404 Sep 24 19:47:44.687467 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 232/424] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:44 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1715 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:44.724817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:44.739708 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-becce88b-dfa2-4443-8b0d-6cd8615f6a36 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.521042 Sep 24 19:47:44.740731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 193/425] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:44 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:45.242986 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:45.243821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:45.244914 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:45.246619 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:45.255244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.259066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.259634 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.260202 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.261598 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.262158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.262793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.263969 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.264419 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.265307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.265671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.267951 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.348503 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.349749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.350819 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.352766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lazy-loading 'fault' on Instance uuid 87f0fca6-b1aa-497c-8198-261ebe0ad34b {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:47:45.432847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:45.444065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9e3d6e10-13d2-4ee3-b688-7fe29baba97e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 200 len: 1303 microversion: 2.1 time: 0.204449 Sep 24 19:47:45.459409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 194/426] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:45 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 1303 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:45.638199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:45.656043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:45.662205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:45.666592 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-385ac87d-776d-41d6-8229-674e36cde212 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.433399 Sep 24 19:47:45.668611 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 233/427] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:45 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:45.763408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:45.764136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:45.782809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.784428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.784887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.785618 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.786087 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.786516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.867528 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-fbf11157-b412-4b93-af92-83d9b5264c05 req-6c324631-04a8-422b-9aaf-350e82ace826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef25795-8222-4f8a-9427-86abea7da3d8", "tag": "5e05d20f-c1e7-402f-9255-05129dfbe981"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:45.888644 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fbf11157-b412-4b93-af92-83d9b5264c05 req-6c324631-04a8-422b-9aaf-350e82ace826 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:45.889431 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fbf11157-b412-4b93-af92-83d9b5264c05 req-6c324631-04a8-422b-9aaf-350e82ace826 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:45.889938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fbf11157-b412-4b93-af92-83d9b5264c05 req-6c324631-04a8-422b-9aaf-350e82ace826 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:45.917309 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-fbf11157-b412-4b93-af92-83d9b5264c05 req-6c324631-04a8-422b-9aaf-350e82ace826 service nova] Creating event network-changed:5e05d20f-c1e7-402f-9255-05129dfbe981 for instance 4ef25795-8222-4f8a-9427-86abea7da3d8 on hv-cinder-85919 Sep 24 19:47:45.930515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-fbf11157-b412-4b93-af92-83d9b5264c05 req-6c324631-04a8-422b-9aaf-350e82ace826 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066521 Sep 24 19:47:45.938744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 234/428] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:45.979110 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:45.988297 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0926d8e0-0f13-46a0-873a-d781da715680 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.228949 Sep 24 19:47:45.988605 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 195/429] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:45 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:46.468006 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:46.468988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: 87f0fca6-b1aa-497c-8198-261ebe0ad34b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:46.473556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:46.482902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:46.489740 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:46.490514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:46.491488 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:46.492178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:46.495857 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:46.527345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] HTTP exception thrown: Instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b could not be found. Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Request method failure captured: Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b HTTP/1.1 Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL17EQsCwyslCQGVAP2kAdiEj8xRXmC9Egv1sItCJLKNwBtVRPNMHdjSIXje15KIdDwbZSmqBWO-raq7p71YUXIOvGmj6ah2N2to0KKwouEz6SXR_AKi8NrcajobojeTDm2UO1hqTznBJgXZY3IzFgpuEmnXCsBKFv-rXnSNDJY_bzUo Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: da8284d3beaa421e893bd04ba33081ea Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesActionsTest-208115232 Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:47:46.529652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesActionsTest-208115232 Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: da8284d3beaa421e893bd04ba33081ea Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesActionsTest-208115232 Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesActionsTest-208115232-project Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 7d6386b432054b0d9c9e347ec8847462 Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesActionsTest-208115232-project Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b could not be found. Sep 24 19:47:46.530988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '87f0fca6-b1aa-497c-8198-261ebe0ad34b'} Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b could not be found. Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:47:46.531795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b could not be found. Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b could not be found. Sep 24 19:47:46.533021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:47:46.535723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Returning 404 to user: Instance 87f0fca6-b1aa-497c-8198-261ebe0ad34b could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:47:46.537329 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8b4ccb54-c259-4d88-a6d5-40305d2d887a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b" status: 404 len: 111 microversion: 2.1 time: 0.074958 Sep 24 19:47:46.538429 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 235/430] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:46 2022] GET /compute/v2.1/servers/87f0fca6-b1aa-497c-8198-261ebe0ad34b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:47:46.598642 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1193860545", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "networks": [{"uuid": "7c249092-b446-4c04-b1e1-abfb33c1e7df"}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:46.675376 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] validate_networks() for [('7c249092-b446-4c04-b1e1-abfb33c1e7df', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:47:46.696142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:46.696954 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:46.705497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:46.706972 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:46.708502 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:46.709828 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:46.710583 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:46.711259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:46.885370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:46.894578 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:46.896398 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:46.897857 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d1ac806f-0dea-44e2-87db-349b60aa9b3d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.206087 Sep 24 19:47:46.899165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 236/431] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:46 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:47.015756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:47.016663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:47.024817 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:47.027241 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:47.027907 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:47.028796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:47.030887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:47.032280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:47.159865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:47:47.162309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:47:47.162309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:47:47.162309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:47:47.162675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:47:47.189272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:47.189674 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:47.190523 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:47.190826 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:47.191190 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:47.191856 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:47.214461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Getting quotas for project da8284d3beaa421e893bd04ba33081ea. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:47:47.219392 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Getting quotas for user 7d6386b432054b0d9c9e347ec8847462 and project da8284d3beaa421e893bd04ba33081ea. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:47:47.233242 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:47:47.235792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:47:47.310058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:47.320601 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-efefdc98-a421-45b7-9a3a-cfc34228062e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.311185 Sep 24 19:47:47.321488 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 237/432] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:47 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:47.409496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-248aab6e-86d3-4471-a444-f31ec9d9ac68 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785361 Sep 24 19:47:47.409496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 196/433] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:47:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:47:47.412729 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ffc79150-270b-430a-9edb-eb70033ecdd4 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:47.413521 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ffc79150-270b-430a-9edb-eb70033ecdd4 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:47.518349 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ffc79150-270b-430a-9edb-eb70033ecdd4 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:47.530158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ffc79150-270b-430a-9edb-eb70033ecdd4 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1214 microversion: 2.1 time: 0.126162 Sep 24 19:47:47.531270 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 238/434] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:47 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:47.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:47.926879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:47.936823 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:47.937597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:47.938038 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:47.938746 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:47.939206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:47.939655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:48.115748 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:48.127519 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:48.129357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:48.131656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-af7f5909-efb3-4d83-81da-fcffff865a79 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1740 microversion: 2.20 time: 0.209358 Sep 24 19:47:48.132712 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 197/435] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:47 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:48.350667 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:48.351494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:48.360666 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:48.362641 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:48.363170 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:48.363855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:48.364648 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:48.365347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:48.365985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:48.508662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:48.517152 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-075a69d7-2979-454b-92f2-0c493b367612 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.170431 Sep 24 19:47:48.517721 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 239/436] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:48 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:48.554170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:48.554814 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:48.560982 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:48.561475 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:48.562117 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:48.562832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:48.563295 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:48.563750 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:48.625963 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:48.633564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-09f73452-75bc-40fd-b5b9-04a11ebcdd9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1266 microversion: 2.1 time: 0.083549 Sep 24 19:47:48.634131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 198/437] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:48 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:49.158083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:49.158674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:49.164848 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:49.165338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:49.166410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:49.167167 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:49.167660 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:49.168088 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:49.183999 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:49.300264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:49.308569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:49.310019 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:49.311234 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-270a20a9-5b8c-43bc-84f9-7c64862b25a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1722 microversion: 2.20 time: 0.157022 Sep 24 19:47:49.311758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 240/438] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:49 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:49.540607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:49.541496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:49.548410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:49.548900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:49.549347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:49.550056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:49.550522 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:49.550949 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:49.657314 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:49.657935 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:49.664207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:49.664702 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:49.665140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:49.665927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:49.666522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:49.666958 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:49.699703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:49.707988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4f4e117d-2b7a-41ba-a577-31cd916ac253 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.171156 Sep 24 19:47:49.708737 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 199/439] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:49 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:49.732663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:49.740310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-530f7fda-282a-441b-9700-0e2a6cfe6d4b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1274 microversion: 2.1 time: 0.086962 Sep 24 19:47:49.740881 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 241/440] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:49 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:50.337165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:50.338266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:50.345077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:50.345578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:50.346118 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:50.346961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:50.347448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:50.347890 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:50.494443 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:50.502943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:50.504442 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:50.505606 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3baf70f3-0f68-4f33-8286-b74d2abd6264 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1722 microversion: 2.20 time: 0.172538 Sep 24 19:47:50.506182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 200/441] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:50 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:50.730383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:50.731127 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:50.737613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:50.738199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:50.738703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:50.739495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:50.740023 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:50.740518 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:50.764338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:50.764944 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:50.771574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:50.772067 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:50.772508 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:50.773209 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:50.773675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:50.774106 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:50.840407 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:50.848935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-45e7463d-7630-4c1f-8c4e-9bf6dbf49bfc tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1272 microversion: 2.1 time: 0.088372 Sep 24 19:47:50.849525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 201/442] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:50 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:51.220058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:51.227660 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5add8b93-5f66-42c2-952a-7301d43bcfac tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.501369 Sep 24 19:47:51.228227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 242/443] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:50 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:51.531841 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:51.532795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:51.539316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:51.539852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:51.540328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:51.541525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:51.542083 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:51.542516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:51.676738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:51.685907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:51.687372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:51.688576 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c3b8bf4f-c660-4050-a997-68c0997935c3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1722 microversion: 2.20 time: 0.160732 Sep 24 19:47:51.689138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 202/444] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:51 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:51.873326 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:51.873948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:51.880647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:51.881139 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:51.881578 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:51.882283 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:51.882747 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:51.883175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:52.104303 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:52.112061 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-28834e0b-1178-45c5-98f5-dbf0d6f30b12 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.243294 Sep 24 19:47:52.112640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 243/445] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:51 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:52.239477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-2b865348-39e5-49c3-9673-40b3441fe505 req-193360bd-5395-4d6d-9ef1-d5f3385b4a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1004979-c29e-4eae-b11c-379cb4632d22", "tag": "b5101e7e-09b2-40c2-b666-1253aeeae2f5"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:52.249611 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2b865348-39e5-49c3-9673-40b3441fe505 req-193360bd-5395-4d6d-9ef1-d5f3385b4a7c service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:52.250097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2b865348-39e5-49c3-9673-40b3441fe505 req-193360bd-5395-4d6d-9ef1-d5f3385b4a7c service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:52.250565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2b865348-39e5-49c3-9673-40b3441fe505 req-193360bd-5395-4d6d-9ef1-d5f3385b4a7c service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:52.252759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:52.253545 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:52.260106 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:52.261321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:52.261899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:52.262698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:52.263563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-2b865348-39e5-49c3-9673-40b3441fe505 req-193360bd-5395-4d6d-9ef1-d5f3385b4a7c service nova] Creating event network-changed:b5101e7e-09b2-40c2-b666-1253aeeae2f5 for instance e1004979-c29e-4eae-b11c-379cb4632d22 on hv-cinder-85919 Sep 24 19:47:52.263722 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:52.264245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:52.268984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-2b865348-39e5-49c3-9673-40b3441fe505 req-193360bd-5395-4d6d-9ef1-d5f3385b4a7c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033121 Sep 24 19:47:52.269992 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 203/446] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:52.398926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:52.407460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-165ff5ee-e8ce-43a0-a822-f89ca26708c7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.159256 Sep 24 19:47:52.408089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 244/447] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:52 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:52.714444 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:52.715149 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:52.721387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:52.721878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:52.722321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:52.723022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:52.723508 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:52.723941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:52.739132 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:52.850461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-6c85167f-5e2b-40f2-aec6-984ef1962a54 req-66c76256-7eed-4ed2-94a7-c297849a245f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff567a7-861e-469a-913d-add40f3220c9", "name": "network-vif-unplugged", "status": "completed", "tag": "8874d4a7-638a-44b3-b521-fda12ba4f441"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:52.863016 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:52.868723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-6c85167f-5e2b-40f2-aec6-984ef1962a54 req-66c76256-7eed-4ed2-94a7-c297849a245f service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:52.869933 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-6c85167f-5e2b-40f2-aec6-984ef1962a54 req-66c76256-7eed-4ed2-94a7-c297849a245f service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:52.870673 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-6c85167f-5e2b-40f2-aec6-984ef1962a54 req-66c76256-7eed-4ed2-94a7-c297849a245f service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:52.879629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:52.881114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:52.882314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-249920cd-4ce1-4624-be0a-ffb340e14e0e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1722 microversion: 2.20 time: 0.172267 Sep 24 19:47:52.882879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 204/448] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:52 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:52.883022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-6c85167f-5e2b-40f2-aec6-984ef1962a54 req-66c76256-7eed-4ed2-94a7-c297849a245f service nova] Creating event network-vif-unplugged:8874d4a7-638a-44b3-b521-fda12ba4f441 for instance bff567a7-861e-469a-913d-add40f3220c9 on hv-cinder-85919 Sep 24 19:47:52.888223 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-6c85167f-5e2b-40f2-aec6-984ef1962a54 req-66c76256-7eed-4ed2-94a7-c297849a245f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041406 Sep 24 19:47:52.888816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 245/449] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:47:53.135173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:53.135826 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:53.141757 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:53.142244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:53.142690 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:53.143384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:53.143872 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:53.144300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:53.275937 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:53.283717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-05629be7-b200-44d5-95f3-468462b9c502 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.152473 Sep 24 19:47:53.284286 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 205/450] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:53 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:53.430656 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:53.431417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:53.437693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:53.438173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:53.438610 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:53.439300 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:53.439788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:53.440211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:53.576149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:53.583836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f95190e8-56eb-461d-ac59-82e8c1fa40af tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.157327 Sep 24 19:47:53.584325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 246/451] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:53 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:53.908237 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:53.909932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:53.916448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:53.916964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:53.917415 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:53.918146 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:53.918612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:53.919042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:54.050040 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:54.059107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:54.060806 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:54.061995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-23850741-7615-48c3-8b61-4f4f6c99f977 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1722 microversion: 2.20 time: 0.157693 Sep 24 19:47:54.062555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 206/452] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:53 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:54.308153 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:54.308744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:54.315070 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:54.315592 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:54.316029 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:54.316720 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:54.317177 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:54.317601 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:54.447233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:54.454932 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-05489622-34c0-48c4-b5cd-162c9ac104b6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.151290 Sep 24 19:47:54.456157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 247/453] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:54 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:54.606512 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:54.607725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:54.613842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:54.614639 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:54.614846 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:54.615528 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:54.615998 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:54.616432 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:54.772716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:54.783064 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8e1f7df3-ea72-4078-9f8a-dd4ae78b9297 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.180799 Sep 24 19:47:54.783710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 207/454] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:54 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:55.088571 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:55.089189 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:55.095209 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:55.095734 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:55.096175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:55.096928 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:55.097392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:55.097822 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:55.226485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:55.234563 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:55.236059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:55.237219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a33537d4-cf23-4bb6-912b-95ad037d1747 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1722 microversion: 2.20 time: 0.152846 Sep 24 19:47:55.237769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 248/455] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:55 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:55.478703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:55.479609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:55.485688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:55.486183 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:55.486645 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:55.487338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:55.487835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:55.488263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:55.621599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:55.629332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-86d5f8bc-1b81-477e-9c43-2d74131ff51a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.155012 Sep 24 19:47:55.629895 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 208/456] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:55 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:55.808274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:55.809831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:55.817490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:55.818112 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:55.818630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:55.819417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:55.820043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:55.820544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.037122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:56.046664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6c6fa35c-3787-42aa-aa54-8cf7b4f7cb37 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.242934 Sep 24 19:47:56.047343 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 249/457] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:55 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:56.263147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:56.264044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:56.270374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.270881 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.271324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.272075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.272567 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.273029 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.416307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:56.426582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:56.428468 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:56.429861 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-87f39337-e909-438e-9c50-4b7728c4086c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1725 microversion: 2.20 time: 0.171580 Sep 24 19:47:56.430627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 209/458] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:56 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:47:56.456251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75292efa-5602-4b13-89b7-c705499c69a1"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:56.458774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:56.465568 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.466059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.466501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.467210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.467776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.468210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.653217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:56.653882 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:56.660818 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.661298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.661739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.662451 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.662919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.663353 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.773490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b37a8cbf-5185-478b-b0a7-d7f7403602fd tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321347 Sep 24 19:47:56.774277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 250/459] 10.222.0.55 () {62 vars in 1364 bytes} [Sat Sep 24 19:47:56 2022] POST /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:47:56.888720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:56.906574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e989f084-32ef-44bf-8d58-a5340da2362b tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.257958 Sep 24 19:47:56.927597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 210/460] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:56 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:56.980688 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:56.981279 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:56.988210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.988707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.989154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:56.989866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:56.990328 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:56.990791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:57.036674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127045) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 19:47:57.070048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:57.070801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:57.077303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:57.077801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:57.078241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:57.078946 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:57.079406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:57.079866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:57.109728 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-44e88361-c5de-429c-b797-755c075060e6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/action" status: 202 len: 0 microversion: 2.20 time: 0.134191 Sep 24 19:47:57.110331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 251/461] 10.222.0.55 () {62 vars in 1319 bytes} [Sat Sep 24 19:47:56 2022] POST /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:47:57.118226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:57.118897 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:57.125232 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:57.125731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:57.126172 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:57.126885 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:57.127351 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:57.127809 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:57.202499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:57.226346 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:57.229374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=6 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:57.236318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7d2f85cd-c563-48ce-b271-913a113376cd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.170059 Sep 24 19:47:57.237091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 211/462] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:57 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:47:57.270542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:57.280701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:57.282214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:57.283391 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-dc8056af-387a-4220-a27b-2e90bb96e770 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1751 microversion: 2.20 time: 0.168952 Sep 24 19:47:57.283954 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 252/463] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:57 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:47:57.932888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:57.933499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:57.940357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:57.941030 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:57.941606 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:57.942473 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:57.943001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:57.943543 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:58.082921 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:58.090741 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-61f7c768-3578-44a3-90ae-969c0b5438b1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.162855 Sep 24 19:47:58.091306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 212/464] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:57 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:58.259639 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:58.260354 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:58.262780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=10 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:58.268848 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:58.269341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:58.269782 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:58.270523 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:58.270985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:58.271412 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:58.316762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:58.317490 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:58.324655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:58.325146 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:58.325582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:58.326286 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:58.326745 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:58.327175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:58.431257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:58.440041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7eb925f7-f7bf-4656-b686-4622f24eca8c tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.184463 Sep 24 19:47:58.440603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 253/465] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:58 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:58.469035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:58.478594 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:58.480537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:58.481707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-eb218198-332a-4682-8222-ffb79e3181f9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1753 microversion: 2.20 time: 0.176475 Sep 24 19:47:58.482269 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 213/466] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:58 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:47:59.050274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-508c3b05-04bc-4fb9-af97-ac1e41b3bbe0 req-410c7a59-ff2d-4f88-99e8-634ab28735bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef25795-8222-4f8a-9427-86abea7da3d8", "name": "network-vif-plugged", "status": "completed", "tag": "5e05d20f-c1e7-402f-9255-05129dfbe981"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:47:59.061239 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-508c3b05-04bc-4fb9-af97-ac1e41b3bbe0 req-410c7a59-ff2d-4f88-99e8-634ab28735bc service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:59.062025 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-508c3b05-04bc-4fb9-af97-ac1e41b3bbe0 req-410c7a59-ff2d-4f88-99e8-634ab28735bc service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:59.062470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-508c3b05-04bc-4fb9-af97-ac1e41b3bbe0 req-410c7a59-ff2d-4f88-99e8-634ab28735bc service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:59.066722 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:59.076316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-508c3b05-04bc-4fb9-af97-ac1e41b3bbe0 req-410c7a59-ff2d-4f88-99e8-634ab28735bc service nova] Creating event network-vif-plugged:5e05d20f-c1e7-402f-9255-05129dfbe981 for instance 4ef25795-8222-4f8a-9427-86abea7da3d8 on hv-cinder-85919 Sep 24 19:47:59.081629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-508c3b05-04bc-4fb9-af97-ac1e41b3bbe0 req-410c7a59-ff2d-4f88-99e8-634ab28735bc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035189 Sep 24 19:47:59.082650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 254/467] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:47:59.113925 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:59.114550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:59.122480 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:59.122985 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:59.123461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:59.124211 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:59.124678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:59.125114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:59.267968 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:59.276160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b3216618-8223-4301-ae88-88b547b2b1ba tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.166255 Sep 24 19:47:59.276730 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 214/468] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:59 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:59.466269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:59.467038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:59.473923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:59.474433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:59.474883 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:59.475757 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:59.476226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:59.476895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:59.508599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:47:59.509435 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:47:59.515902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:59.516560 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:59.517104 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:59.518039 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:47:59.518717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:47:59.519225 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:47:59.660510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:59.669566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e03ee071-58c6-4019-81a4-92cf61e7b089 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.209659 Sep 24 19:47:59.670467 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 255/469] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:47:59 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:47:59.679617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:59.689627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:59.691206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:47:59.692440 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0c1a6890-972a-408d-84e1-01783bd19560 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1753 microversion: 2.20 time: 0.187979 Sep 24 19:47:59.693009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 215/470] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:47:59 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:48:00.300839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:00.301376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:00.308203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:00.308689 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:00.309131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:00.309860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:00.310317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:00.310742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:00.440614 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:00.448555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-60b2b156-edea-4e74-b167-425c51c38a46 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.151621 Sep 24 19:48:00.449129 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 256/471] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:00 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:00.692381 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:00.693205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:00.700011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:00.700743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:00.701188 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:00.701899 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:00.702366 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:00.702793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:00.718203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:00.718962 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:00.725224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:00.725716 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:00.726154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:00.726853 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:00.727308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:00.727759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:00.840316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:00.848042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0739d9cd-03b9-45dc-bc0b-c14456e67a97 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1261 microversion: 2.1 time: 0.159576 Sep 24 19:48:00.848612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 216/472] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:00 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:00.866563 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:00.875802 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:00.877313 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:00.878518 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-47aad2bf-56c9-4edd-86e0-c5b867dbe2b2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.164185 Sep 24 19:48:00.879083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 257/473] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:00 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:48:01.096653 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-7a3081b5-c0ba-4b89-817e-30fdbd307569 req-155dd7b0-ba3f-494d-ad3d-cd19646d9b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1004979-c29e-4eae-b11c-379cb4632d22", "name": "network-vif-plugged", "status": "completed", "tag": "b5101e7e-09b2-40c2-b666-1253aeeae2f5"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:01.106966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-7a3081b5-c0ba-4b89-817e-30fdbd307569 req-155dd7b0-ba3f-494d-ad3d-cd19646d9b4a service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:01.107468 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-7a3081b5-c0ba-4b89-817e-30fdbd307569 req-155dd7b0-ba3f-494d-ad3d-cd19646d9b4a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:01.107905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-7a3081b5-c0ba-4b89-817e-30fdbd307569 req-155dd7b0-ba3f-494d-ad3d-cd19646d9b4a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:01.119543 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-7a3081b5-c0ba-4b89-817e-30fdbd307569 req-155dd7b0-ba3f-494d-ad3d-cd19646d9b4a service nova] Creating event network-vif-plugged:b5101e7e-09b2-40c2-b666-1253aeeae2f5 for instance e1004979-c29e-4eae-b11c-379cb4632d22 on hv-cinder-85919 Sep 24 19:48:01.124384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-7a3081b5-c0ba-4b89-817e-30fdbd307569 req-155dd7b0-ba3f-494d-ad3d-cd19646d9b4a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031497 Sep 24 19:48:01.124977 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 217/474] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:01.470246 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:01.470866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:01.476926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:01.477412 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:01.477852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:01.479049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:01.479540 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:01.479968 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:01.613155 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:01.620948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-071fb819-ec5d-4655-9eaf-07d6a9eb7e28 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.154674 Sep 24 19:48:01.621521 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 258/475] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:01 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:01.871375 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:01.872084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:01.878247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:01.878740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:01.879186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:01.879917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:01.880390 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:01.880828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:01.906396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:01.907024 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:01.913325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:01.913823 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:01.914272 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:01.914982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:01.915535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:01.916345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:02.019975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:02.028416 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-31e50b10-247b-4e41-923b-a5ca13b21bd1 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1445 microversion: 2.1 time: 0.161871 Sep 24 19:48:02.028998 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 218/476] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:01 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1445 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:02.051522 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:02.052135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:02.058729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:02.059510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:02.060229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:02.060946 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:02.061430 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:02.061838 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:02.152459 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:02.162875 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:02.164460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:02.166307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ea27b88f-7b21-4ce4-a087-204acc76bcd1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.263397 Sep 24 19:48:02.166946 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 259/477] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:01 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:48:02.208400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:02.216826 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bb63bf67-d1c0-4379-9658-401287b4e234 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1445 microversion: 2.1 time: 0.169149 Sep 24 19:48:02.217405 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 219/478] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:02 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:02.644313 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:02.645131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:02.653668 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:02.654868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:02.655363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:02.656723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:02.657295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:02.658703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:02.795531 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:02.803993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3cdd5de0-27ed-48cc-b360-aa9ed642063e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.163375 Sep 24 19:48:02.815447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 260/479] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:02 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:03.192977 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:03.193889 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:03.202025 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:03.202777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:03.203321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:03.204127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:03.204686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:03.205462 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:03.419987 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:03.428953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:03.431116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:03.432345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5ca01dd5-d764-4d17-b760-deb489f1e412 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.243684 Sep 24 19:48:03.432903 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 220/480] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:03 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:03.828884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:03.830423 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:03.837541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:03.838341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:03.838796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:03.839551 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:03.840026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:03.840470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:03.933827 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-d63ce064-a951-44f6-87b8-d2dea0b031f7 req-0d41f74c-8fa3-4075-9f0b-350d46981e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef25795-8222-4f8a-9427-86abea7da3d8", "tag": "5e05d20f-c1e7-402f-9255-05129dfbe981"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:03.943484 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-d63ce064-a951-44f6-87b8-d2dea0b031f7 req-0d41f74c-8fa3-4075-9f0b-350d46981e2e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:03.943977 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-d63ce064-a951-44f6-87b8-d2dea0b031f7 req-0d41f74c-8fa3-4075-9f0b-350d46981e2e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:03.944896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-d63ce064-a951-44f6-87b8-d2dea0b031f7 req-0d41f74c-8fa3-4075-9f0b-350d46981e2e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:03.955961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-d63ce064-a951-44f6-87b8-d2dea0b031f7 req-0d41f74c-8fa3-4075-9f0b-350d46981e2e service nova] Creating event network-changed:5e05d20f-c1e7-402f-9255-05129dfbe981 for instance 4ef25795-8222-4f8a-9427-86abea7da3d8 on hv-cinder-85919 Sep 24 19:48:03.960898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-d63ce064-a951-44f6-87b8-d2dea0b031f7 req-0d41f74c-8fa3-4075-9f0b-350d46981e2e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031706 Sep 24 19:48:03.961492 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 221/481] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:48:03.982436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:03.991940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d9d18c9c-fea3-4c9f-b1a7-379af9ef174e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1314 microversion: 2.1 time: 0.167774 Sep 24 19:48:03.992517 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 261/482] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:03 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:04.459892 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:04.460595 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:04.467135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:04.468636 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:04.469074 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:04.469789 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:04.470529 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:04.470957 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:04.487891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:04.605780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:04.614614 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:04.616105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:04.617417 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-37e9c955-50fa-45fd-9870-5553031c8eb2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.162391 Sep 24 19:48:04.617984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 222/483] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:04 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:05.016262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:05.016911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:05.029432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:05.029974 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:05.030498 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:05.031292 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:05.031838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:05.032281 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:05.235650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:05.244914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-45c7acca-5ef4-4621-b96d-187460f192a6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1497 microversion: 2.1 time: 0.231917 Sep 24 19:48:05.256186 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 262/484] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:05 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:05.644277 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:05.645600 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:05.649469 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:05.655569 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:05.656909 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:05.657485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:05.658287 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:05.659030 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:05.659723 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:05.809113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:05.818073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:05.819583 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:05.820837 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-934a9a3d-4fde-453f-9927-2f47b8eafa2a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.180704 Sep 24 19:48:05.821319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 223/485] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:05 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:05.969008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:05.969516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:05.975603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:05.976102 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:05.976544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:05.977259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:05.977722 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:05.978281 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:06.006188 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:48:06.096852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f3cb541a-94da-4e4c-badf-cb5963f9428e tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 204 len: 0 microversion: 2.1 time: 0.131617 Sep 24 19:48:06.097741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 263/486] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:48:05 2022] DELETE /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:48:06.107356 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:06.108108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:06.114270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:06.114850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:06.115364 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:06.116184 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:06.116719 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:06.117317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:06.268409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:06.269126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5e18f3e3-599f-43b5-85af-171f939919d1 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.166840 Sep 24 19:48:06.269926 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 224/487] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:06 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:06.849565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:06.850752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:06.857580 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:06.858168 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:06.858687 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:06.859566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:06.860214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:06.860650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:07.011749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:07.020851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:07.022426 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:07.023703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7bf9cf30-7396-4002-ae17-54533f66d4ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.178971 Sep 24 19:48:07.024265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 264/488] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:06 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:07.294004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:07.295738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:07.303029 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:07.303677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:07.304271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:07.305063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:07.305594 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:07.306691 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:07.444220 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:07.452761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0555d47c-fb64-4b45-8360-d8d08c779da6 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.163185 Sep 24 19:48:07.454288 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 225/489] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:07 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:08.050409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:08.051086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:08.068321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:08.068704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:08.069080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:08.077505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:08.077505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:08.077505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:08.218603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:08.227419 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:08.229091 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:08.230261 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1093d6ff-4b56-4e9f-8bdf-60e2361d4830 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.183954 Sep 24 19:48:08.230820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 265/490] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:08 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:08.478343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:08.478971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:08.485706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:08.486199 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:08.486637 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:08.487341 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:08.487824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:08.488249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:08.628656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:08.638427 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2c8c0a56-7c30-4bb3-9123-11e68977d9ab tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.164232 Sep 24 19:48:08.639114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 226/491] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:08 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:09.256435 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:09.257118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:09.263804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:09.264309 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:09.264752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:09.265462 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:09.265926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:09.266360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:09.408401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:09.417435 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:09.418897 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:09.420356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e0637514-8728-4af3-bbfa-51ac04a79612 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.167881 Sep 24 19:48:09.420911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 266/492] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:09 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:09.662483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:09.664010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:09.671235 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:09.671842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:09.672345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:09.673114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:09.673604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:09.674032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:09.812917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:09.820919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2b93538a-0300-40a1-995b-ec952f181254 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.162342 Sep 24 19:48:09.821546 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 227/493] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:09 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:10.446331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:10.447275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:10.453886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:10.454381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:10.454826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:10.455573 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:10.456048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:10.456485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:10.594048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:10.603531 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:10.605275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:10.606634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-97f51dc2-cb17-4558-a082-f13bccaf5475 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.164270 Sep 24 19:48:10.623451 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 267/494] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:10 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:10.846255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:10.846923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:10.853830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:10.854488 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:10.854927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:10.855654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:10.856112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:10.856540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:11.008173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:11.016123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ea57bab7-d768-47c3-8968-2600a6928544 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.173810 Sep 24 19:48:11.016695 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 228/495] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:10 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:11.632321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:11.632942 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:11.640121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:11.641000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:11.641440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:11.642165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:11.642621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:11.643047 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:11.781210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:11.790916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:11.793432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:11.794899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4a6ccaa2-f0ce-46e6-ac27-88ddd60e19da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.166670 Sep 24 19:48:11.795472 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 268/496] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:11 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:12.038154 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:12.038777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:12.046788 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:12.047291 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:12.047800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:12.048498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:12.048971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:12.049402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:12.201236 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:12.208800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ef7b1095-5c40-4c60-a552-feaa22331fc7 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.174564 Sep 24 19:48:12.209366 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 229/497] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:12 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:12.821221 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:12.822014 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:12.829002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:12.829539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:12.830055 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:12.830866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:12.831360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:12.831852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:12.973315 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:12.975934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:12.985260 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:12.986720 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:12.987941 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-21090a01-56e5-4e9a-9306-395c4f2d178e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.170814 Sep 24 19:48:12.988698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 269/498] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:12 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:13.232412 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:13.233036 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:13.239458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:13.239940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:13.240374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:13.241064 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:13.241525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:13.241976 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:13.386891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:13.395075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-60809a53-e93b-43d7-b059-8529c0a7ec9f tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.166480 Sep 24 19:48:13.395699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 230/499] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:13 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:14.018901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:14.019801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:14.029921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:14.030986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:14.031643 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:14.032365 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:14.033157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:14.033595 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:14.191519 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:14.201114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:14.202562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:14.203752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-99f4480e-1b18-47f7-9fc8-7e1b48c6c010 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.189524 Sep 24 19:48:14.204304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 270/500] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:14 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:14.419923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:14.420561 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:14.427761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:14.428271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:14.428720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:14.429467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:14.429956 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:14.430377 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:14.576970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:14.585816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b9fc52f6-b641-4757-987e-099947f9f848 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.170813 Sep 24 19:48:14.586513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 231/501] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:14 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:15.230193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:15.230851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:15.237875 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:15.238572 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:15.239207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:15.240064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:15.240596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:15.241096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:15.383183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:15.392628 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:15.394100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:15.395305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8f700cbc-b63c-4d86-b2bd-1d1f542819d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.169195 Sep 24 19:48:15.395896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 271/502] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:15 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:15.608816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:15.609430 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:15.616171 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:15.616660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:15.617095 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:15.617793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:15.618301 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:15.618725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:15.751113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:15.759652 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-49a0b451-08b7-49a4-b990-e2d8e184536c tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.153993 Sep 24 19:48:15.760478 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 232/503] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:15 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:16.422240 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:16.422851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:16.429414 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:16.429905 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:16.430364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:16.432058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:16.432547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:16.432990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:16.564381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:16.573318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:16.574761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:16.575990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-14962161-22ca-45ec-91a7-432d673afa2e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.158071 Sep 24 19:48:16.576550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 272/504] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:16 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:16.782712 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:16.783365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:16.789897 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:16.791010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:16.791490 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:16.792208 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:16.792680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:16.793121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:16.927749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:16.936838 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ba856dea-ecb6-4d28-9567-3f9c5bde644d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.157968 Sep 24 19:48:16.937418 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 233/505] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:16 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:17.601587 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:17.602153 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:17.606321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:17.610199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:17.610691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:17.611131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:17.611988 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:17.612450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:17.612881 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:17.745843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:17.754368 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:17.755833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:17.756985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9a8ae0fe-3247-4e5b-9976-4ff6b44f1639 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.159590 Sep 24 19:48:17.757540 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 273/506] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:17 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:17.959675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:17.960288 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:17.967311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:17.967821 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:17.968255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:17.968943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:17.969465 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:17.969892 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:18.100109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:18.108272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0632319f-f473-4492-b97a-bf5d69dbe41a tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.152448 Sep 24 19:48:18.108849 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 234/507] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:17 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:18.783496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:18.784120 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:18.791375 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:18.791903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:18.792344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:18.793048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:18.793507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:18.793930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:18.930470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:18.945838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:18.948705 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:18.950838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-70d34262-c8a4-427a-8cab-ace9161c1752 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.171089 Sep 24 19:48:18.951865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 274/508] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:18 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:19.134519 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:19.135128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:19.141736 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:19.142214 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:19.142655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:19.143382 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:19.143874 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:19.144303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:19.516347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:19.524126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9e7e2e98-3d3a-45c2-a50a-5450c66f9a41 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1503 microversion: 2.1 time: 0.393521 Sep 24 19:48:19.525265 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 235/509] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:19 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:19.760508 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-b56a582f-a5ea-4826-8525-503d803b4c15 req-3fcaa370-f5e3-487f-96fb-1ab1e75a7082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1004979-c29e-4eae-b11c-379cb4632d22", "name": "network-vif-deleted", "tag": "b5101e7e-09b2-40c2-b666-1253aeeae2f5"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:19.770322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b56a582f-a5ea-4826-8525-503d803b4c15 req-3fcaa370-f5e3-487f-96fb-1ab1e75a7082 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:19.770797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b56a582f-a5ea-4826-8525-503d803b4c15 req-3fcaa370-f5e3-487f-96fb-1ab1e75a7082 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:19.771231 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b56a582f-a5ea-4826-8525-503d803b4c15 req-3fcaa370-f5e3-487f-96fb-1ab1e75a7082 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:19.782498 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-b56a582f-a5ea-4826-8525-503d803b4c15 req-3fcaa370-f5e3-487f-96fb-1ab1e75a7082 service nova] Creating event network-vif-deleted:b5101e7e-09b2-40c2-b666-1253aeeae2f5 for instance e1004979-c29e-4eae-b11c-379cb4632d22 on hv-cinder-85919 Sep 24 19:48:19.787532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-b56a582f-a5ea-4826-8525-503d803b4c15 req-3fcaa370-f5e3-487f-96fb-1ab1e75a7082 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 Sep 24 19:48:19.788562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 275/510] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:19.977177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:19.978577 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:19.984544 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:19.985035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:19.985474 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:19.986173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:19.986632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:19.987056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:20.127978 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:20.137160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:20.138633 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:20.139846 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3c6cb29b-f11d-4801-b502-fd9ef5a22eff tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.166662 Sep 24 19:48:20.140454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 236/511] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:19 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:20.550286 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:20.550906 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:20.558213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:20.558711 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:20.559157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:20.559923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:20.560391 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:20.560825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:20.593097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:20.593594 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:20.594043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:20.594499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lazy-loading 'fault' on Instance uuid e1004979-c29e-4eae-b11c-379cb4632d22 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:48:20.644562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6386b432054b0d9c9e347ec8847462', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8284d3beaa421e893bd04ba33081ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:20.653045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fcc61f6e-fb43-4c64-950a-4ec60b0f243d tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 200 len: 1304 microversion: 2.1 time: 0.107769 Sep 24 19:48:20.653717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 276/512] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:20 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:21.167111 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:21.167111 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:21.174101 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.174581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.175018 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.175742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.176222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.176647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.310367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:21.319343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:21.320785 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:21.321998 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c6f9d579-b918-4492-9096-739cc3bfc3f7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.160058 Sep 24 19:48:21.322562 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 237/513] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:21 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:48:21.531168 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:21.533496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:21.539502 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.540570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.541018 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.541818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.542282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.542715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.619084 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-54966806-c789-4c59-bda5-2373f9ff2688 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/action" status: 202 len: 0 microversion: 2.1 time: 0.091540 Sep 24 19:48:21.623086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 277/514] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:48:21 2022] POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:48:21.628448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:21.629085 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:21.635734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.636239 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.636676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.637384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.637871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.638266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.682701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:21.683470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] [instance: e1004979-c29e-4eae-b11c-379cb4632d22] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:21.690255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.690753 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.691194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.691946 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.692413 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.692906 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.707314 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] HTTP exception thrown: Instance e1004979-c29e-4eae-b11c-379cb4632d22 could not be found. Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Request method failure captured: Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 HTTP/1.1 Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL17EQsCwyslCQGVAP2kAdiEj8xRXmC9Egv1sItCJLKNwBtVRPNMHdjSIXje15KIdDwbZSmqBWO-raq7p71YUXIOvGmj6ah2N2to0KKwouEz6SXR_AKi8NrcajobojeTDm2UO1hqTznBJgXZY3IzFgpuEmnXCsBKFv-rXnSNDJY_bzUo Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: da8284d3beaa421e893bd04ba33081ea Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesActionsTest-208115232 Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:48:21.709026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/da8284d3beaa421e893bd04ba33081ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesActionsTest-208115232 Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: da8284d3beaa421e893bd04ba33081ea Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesActionsTest-208115232 Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesActionsTest-208115232-project Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 7d6386b432054b0d9c9e347ec8847462 Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesActionsTest-208115232-project Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance e1004979-c29e-4eae-b11c-379cb4632d22 could not be found. Sep 24 19:48:21.710570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': 'e1004979-c29e-4eae-b11c-379cb4632d22'} Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1004979-c29e-4eae-b11c-379cb4632d22 could not be found. Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:48:21.711483 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1004979-c29e-4eae-b11c-379cb4632d22 could not be found. Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1004979-c29e-4eae-b11c-379cb4632d22 could not be found. Sep 24 19:48:21.714335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.715465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] Returning 404 to user: Instance e1004979-c29e-4eae-b11c-379cb4632d22 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:48:21.715465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9a2ec912-be37-499f-addf-74dd15374ea3 tempest-VolumesActionsTest-208115232 tempest-VolumesActionsTest-208115232-project] 10.222.0.55 "GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22" status: 404 len: 111 microversion: 2.1 time: 0.032121 Sep 24 19:48:21.715465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 278/515] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:21 2022] GET /compute/v2.1/servers/e1004979-c29e-4eae-b11c-379cb4632d22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:48:21.725744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:21.726264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:21.733634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.734530 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.734965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.735718 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.736181 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.736796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.783730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-532c7389-ac1f-43f8-a0dd-31f66645aa03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef/ips" status: 200 len: 149 microversion: 2.1 time: 0.061807 Sep 24 19:48:21.784683 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 279/516] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:48:21 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:48:21.796767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:21.798852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fec16fd3-0f19-430a-9f1a-e2395994477b"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:21.801304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:21.806470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9574a6ae-05b0-4d70-a4ec-723a77d34f54 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1751 microversion: 2.1 time: 0.181379 Sep 24 19:48:21.819465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.819465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.819465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.819465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.820086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.820086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.820727 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 238/517] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:21 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:21.907338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Invalid volume: volume fec16fd3-0f19-430a-9f1a-e2395994477b is already attached to instances: 80229451-4d17-4bee-9b50-a0cc56402c62 Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: POST /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef/os-volume_attachments HTTP/1.1 Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 74 Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:48:21.909016 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {"volumeAttachment": {"volumeId": "fec16fd3-0f19-430a-9f1a-e2395994477b"}} Sep 24 19:48:21.910333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Invalid volume: volume fec16fd3-0f19-430a-9f1a-e2395994477b is already attached to instances: 80229451-4d17-4bee-9b50-a0cc56402c62 Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'server_id': '3ff9117a-11ce-4612-9153-8356567961ef', 'body': {'volumeAttachment': {'volumeId': 'fec16fd3-0f19-430a-9f1a-e2395994477b'}}} Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fec16fd3-0f19-430a-9f1a-e2395994477b is already attached to instances: 80229451-4d17-4bee-9b50-a0cc56402c62 Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.911510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fec16fd3-0f19-430a-9f1a-e2395994477b is already attached to instances: 80229451-4d17-4bee-9b50-a0cc56402c62 Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:21.912924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:21.914224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:21.914224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:48:21.914224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:48:21.914224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fec16fd3-0f19-430a-9f1a-e2395994477b is already attached to instances: 80229451-4d17-4bee-9b50-a0cc56402c62 Sep 24 19:48:21.914224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:21.914224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 400 to user: Invalid volume: volume fec16fd3-0f19-430a-9f1a-e2395994477b is already attached to instances: 80229451-4d17-4bee-9b50-a0cc56402c62 {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:48:21.914224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1a47fcb7-3e5d-4ccb-80d6-64d2ff71b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117722 Sep 24 19:48:21.914687 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 280/518] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:48:21 2022] POST /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 19:48:21.921168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:21.921682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:21.928211 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.928714 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.929154 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.931233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:21.931870 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:21.932383 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:21.936990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:21.963498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:48:22.074399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e4030aca-10c9-4eac-83fd-57aa642939e0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 204 len: 0 microversion: 2.1 time: 0.156847 Sep 24 19:48:22.075185 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 239/519] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:48:21 2022] DELETE /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:48:22.085550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:22.086178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:22.094183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:22.094806 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:22.095255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:22.096161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:22.096634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:22.097068 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:22.247326 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:22.256978 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fe859608-6662-4abf-9c3a-9a4018844b68 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1679 microversion: 2.1 time: 0.177495 Sep 24 19:48:22.257543 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 281/520] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:22 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:22.347905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:22.348616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:22.355210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:22.355797 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:22.356253 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:22.357049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:22.357515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:22.357956 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:22.500496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:22.510208 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:22.511727 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:22.512912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5bdf2cc4-634c-4362-8d6c-e424cb55dc19 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.169428 Sep 24 19:48:22.513630 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 240/521] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:22 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:48:22.833042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:22.833657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:22.841519 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:22.842009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:22.842542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:22.843410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:22.844038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:22.844567 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:23.006910 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:23.015398 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b8adf299-2479-485e-be4b-6c37ee891768 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1751 microversion: 2.1 time: 0.186534 Sep 24 19:48:23.016002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 282/522] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:22 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:23.280822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:23.281438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:23.287610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:23.288105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:23.288547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:23.289254 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:23.289820 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:23.290774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:23.421162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:23.429074 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0aac5147-34b9-45c9-91bd-b01c69277f85 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1679 microversion: 2.1 time: 0.152327 Sep 24 19:48:23.429643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 241/523] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:23 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:23.543579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:23.544104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:23.550338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:23.550826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:23.551262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:23.551987 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:23.552574 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:23.553000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:23.683743 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:23.692489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:23.693934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:23.695122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-bc1090a9-78bd-4465-b3aa-50424b5b93d5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.156223 Sep 24 19:48:23.695707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 283/524] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:23 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:24.041296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:24.041913 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:24.048364 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:24.048852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:24.049299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:24.049996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:24.050470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:24.050890 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:24.193111 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:24.202236 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5ad3c36f-d27a-45c2-95a3-b6b6f2008ca5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1751 microversion: 2.1 time: 0.165417 Sep 24 19:48:24.204920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 242/525] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:24 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:24.454127 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:24.454777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:24.461290 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:24.462357 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:24.462793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:24.463515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:24.463977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:24.464399 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:24.598051 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:24.606582 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-56dbde51-0de0-43a8-9b43-f3e5c2c35d0a tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1679 microversion: 2.1 time: 0.156278 Sep 24 19:48:24.607149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 284/526] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:24 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:24.721090 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:24.721658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:24.728728 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:24.729221 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:24.729663 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:24.730374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:24.730834 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:24.731265 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:24.864556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:24.873073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:24.874573 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:24.875764 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-227e1b0d-669e-4e22-afb4-26f90d7fc8e1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.158750 Sep 24 19:48:24.876326 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 243/527] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:24 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:25.226465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:25.227075 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:25.233585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:25.234076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:25.234517 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:25.235217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:25.235711 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:25.236145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:25.392246 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:25.400737 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7eb576f4-211a-4fa2-ae7d-6344c97a4876 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1751 microversion: 2.1 time: 0.178181 Sep 24 19:48:25.401314 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 285/528] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:25 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:25.630375 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:25.630915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:25.637136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:25.637629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:25.638078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:25.638782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:25.639251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:25.639729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:25.768688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:25.776522 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a28149d4-8900-44e8-8f25-bb550bcb97c9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1679 microversion: 2.1 time: 0.150146 Sep 24 19:48:25.777089 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 244/529] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:25 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:25.901240 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:25.901856 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:25.908350 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:25.908840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:25.909280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:25.909976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:25.910438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:25.910868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:26.041044 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:26.043455 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:26.051469 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:26.052927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:26.054094 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fa66482b-045d-46ae-959f-b6f32848ebce tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.156998 Sep 24 19:48:26.054658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 286/530] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:25 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:26.424825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:26.425434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:26.431717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:26.432211 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:26.432650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:26.433349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:26.433807 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:26.434233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:26.578834 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:26.587786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-77a3b06b-7e5d-44bf-8833-d0be96f8ba24 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1751 microversion: 2.1 time: 0.166846 Sep 24 19:48:26.588462 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 245/531] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:26 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:26.800922 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:26.801454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:26.809577 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:26.810071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:26.810513 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:26.811219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:26.811713 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:26.812147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:26.942306 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:26.951053 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-029b0ed5-280d-4cae-8dbf-7d43df30849b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1679 microversion: 2.1 time: 0.154104 Sep 24 19:48:26.951662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 287/532] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:26 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:27.079739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:27.080371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:27.087313 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:27.087850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:27.088296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:27.089016 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:27.089483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:27.089916 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:27.241401 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:27.251658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:27.253384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:27.255034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b7cbc599-9114-4d82-81a8-0227c80da4f0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.179211 Sep 24 19:48:27.255876 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 246/533] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:27 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:27.612997 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:27.613964 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:27.623898 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:27.625050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:27.625866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:27.626951 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:27.627753 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:27.628357 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:27.939611 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:27.948259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-083093e0-c5bb-4d34-bb2a-7d91f8c54b95 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1751 microversion: 2.1 time: 0.339515 Sep 24 19:48:27.956723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 288/534] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:27 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1751 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:27.981001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:27.982157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:28.001945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:28.014180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:28.021249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:28.022149 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:28.022715 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:28.028258 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:28.281661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:28.282274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:28.289470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:28.292732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:28.293456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:28.294691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:28.296777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:28.297546 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:28.304324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:28.318349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-38c789d2-0581-4372-8293-2e9fe405ab72 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1679 microversion: 2.1 time: 0.347791 Sep 24 19:48:28.318954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 247/535] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:27 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1679 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:28.536499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:28.549961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:28.552433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:28.554293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5051ef53-afd2-45b2-85e8-a2f3100293e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.276609 Sep 24 19:48:28.566674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 289/536] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:28 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:48:28.982797 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:28.983471 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:28.992252 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:28.993516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-e5e9d2b6-69ab-47c0-8225-3626518565be req-3b889a65-591b-467a-9f34-36a29332d456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff9117a-11ce-4612-9153-8356567961ef", "name": "network-vif-deleted", "tag": "2a1ece25-0e03-454a-b128-725cca130281"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:28.996121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:28.996578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:28.997315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:29.000103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:29.000684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:29.038715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e5e9d2b6-69ab-47c0-8225-3626518565be req-3b889a65-591b-467a-9f34-36a29332d456 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:29.046384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e5e9d2b6-69ab-47c0-8225-3626518565be req-3b889a65-591b-467a-9f34-36a29332d456 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:29.048504 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e5e9d2b6-69ab-47c0-8225-3626518565be req-3b889a65-591b-467a-9f34-36a29332d456 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:29.075324 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-e5e9d2b6-69ab-47c0-8225-3626518565be req-3b889a65-591b-467a-9f34-36a29332d456 service nova] Creating event network-vif-deleted:2a1ece25-0e03-454a-b128-725cca130281 for instance 3ff9117a-11ce-4612-9153-8356567961ef on hv-cinder-85919 Sep 24 19:48:29.082430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-e5e9d2b6-69ab-47c0-8225-3626518565be req-3b889a65-591b-467a-9f34-36a29332d456 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099532 Sep 24 19:48:29.083703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 290/537] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:29.282362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:29.293469 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2e98c871-cdf8-436f-870b-6c9fc9f84ae6 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.314660 Sep 24 19:48:29.295123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 248/538] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:28 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:29.356476 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:29.357191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:29.365010 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:29.365909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:29.366576 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:29.367825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:29.368517 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:29.369209 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:29.427107 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:29.427686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:29.428369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:29.429059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lazy-loading 'fault' on Instance uuid 3ff9117a-11ce-4612-9153-8356567961ef {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:48:29.481586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:29.490901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3e624dd4-dcca-497a-bec4-6927987074e3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 200 len: 1330 microversion: 2.1 time: 0.140187 Sep 24 19:48:29.491998 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 291/539] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:29 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 1330 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:29.581778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:29.582406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:29.591686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:29.592196 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:29.592632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:29.593353 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:29.593819 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:29.598629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:29.854967 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:29.865921 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:29.868217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:29.869981 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-871b52d2-082a-4e1f-8747-f0794c2b248f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.292553 Sep 24 19:48:29.870756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 249/540] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:29 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:30.307582 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-1f4f1745-3a0c-4648-9b14-04411b17d6d3 req-7edb7dc8-ebe9-4dd6-8220-aa44c36868b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff567a7-861e-469a-913d-add40f3220c9", "name": "network-vif-plugged", "status": "completed", "tag": "8874d4a7-638a-44b3-b521-fda12ba4f441"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:30.318357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:30.318985 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:30.326158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-1f4f1745-3a0c-4648-9b14-04411b17d6d3 req-7edb7dc8-ebe9-4dd6-8220-aa44c36868b5 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:30.326654 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-1f4f1745-3a0c-4648-9b14-04411b17d6d3 req-7edb7dc8-ebe9-4dd6-8220-aa44c36868b5 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:30.327092 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-1f4f1745-3a0c-4648-9b14-04411b17d6d3 req-7edb7dc8-ebe9-4dd6-8220-aa44c36868b5 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:30.330553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:30.331563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:30.332189 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:30.333246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:30.340641 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:30.341839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:30.357914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-1f4f1745-3a0c-4648-9b14-04411b17d6d3 req-7edb7dc8-ebe9-4dd6-8220-aa44c36868b5 service nova] Creating event network-vif-plugged:8874d4a7-638a-44b3-b521-fda12ba4f441 for instance bff567a7-861e-469a-913d-add40f3220c9 on hv-cinder-85919 Sep 24 19:48:30.373913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-1f4f1745-3a0c-4648-9b14-04411b17d6d3 req-7edb7dc8-ebe9-4dd6-8220-aa44c36868b5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070881 Sep 24 19:48:30.375122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 292/541] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:30.515511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:30.516318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:30.531867 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:30.532645 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:30.533264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:30.534410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:30.535039 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:30.535653 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:30.572405 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef HTTP/1.1 Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:48:30.574149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:48:30.575784 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '3ff9117a-11ce-4612-9153-8356567961ef'} Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:48:30.576675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:48:30.578161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:48:30.579473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:48:30.579473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3ecad299-3b6b-4a86-b526-937c7813c750 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 404 len: 111 microversion: 2.1 time: 0.064738 Sep 24 19:48:30.598145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 293/542] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:30 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:48:30.606501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3614aae6-f34d-4243-8f23-5e42ba1b32e4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '.version_select at 0x7f5417b6ad30>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:30.636506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3614aae6-f34d-4243-8f23-5e42ba1b32e4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068597756" status: 202 len: 0 microversion: 2.1 time: 0.034900 Sep 24 19:48:30.637459 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 294/543] 10.222.0.55 () {58 vars in 1221 bytes} [Sat Sep 24 19:48:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068597756 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:48:30.667400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:30.680542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0929a5bb-1a17-4cbe-bd44-d2943bdd61f4 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.365396 Sep 24 19:48:30.696428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 250/544] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:30 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:30.903562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:30.904335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:30.938626 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:30.940100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:30.940935 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:30.946621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:30.949076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:30.950047 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:31.429837 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:31.443108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:31.444591 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:31.446381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-dd1804c1-0f7b-448d-b6e4-eac087dbd2d0 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.549765 Sep 24 19:48:31.446933 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 295/545] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:30 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:31.708835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:31.710279 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:31.718138 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:31.719070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:31.720201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:31.723497 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:31.724284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:31.724905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:31.934457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:31.934976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:31.943839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:31.944778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:31.946478 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:31.947842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:31.949072 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:31.949755 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:31.996047 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:32.005041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6474c32d-d851-4e35-8def-a2ae43327b61 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.302255 Sep 24 19:48:32.006788 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 251/546] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:31 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:32.154963 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lazy-loading 'services' on Instance uuid 80229451-4d17-4bee-9b50-a0cc56402c62 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:48:32.308177 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-365a934c-c686-4a71-bce6-efd50ac1898c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments/fec16fd3-0f19-430a-9f1a-e2395994477b" status: 202 len: 0 microversion: 2.1 time: 0.379854 Sep 24 19:48:32.311954 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 296/547] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:48:31 2022] DELETE /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments/fec16fd3-0f19-430a-9f1a-e2395994477b => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 19:48:32.317251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:32.319897 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:32.326338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:32.327076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:32.327703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:32.328597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:32.329053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:32.329477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:32.367488 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b24eb49f-abd3-43bf-837d-4a6863eaf6d4 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054137 Sep 24 19:48:32.369442 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 252/548] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:48:32 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:32.475801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:32.477873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:32.486590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:32.487635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:32.488404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:32.489114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:32.489576 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:32.490000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:32.679099 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:32.692708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:32.694197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:32.697278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e94ff114-876f-4660-b4fc-99f7109dbba5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.225879 Sep 24 19:48:32.698521 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 297/549] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:32 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:33.034793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:33.037123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:33.051281 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:33.052307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:33.053181 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:33.054945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:33.056774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:33.057756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:33.277362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:33.286469 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ceb81046-f040-4803-bd50-84793ce1fec1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.259933 Sep 24 19:48:33.287671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 253/550] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:33 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:33.387151 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:33.391084 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:33.402793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:33.404356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:33.405198 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:33.411412 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:33.412009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:33.412382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:33.472067 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e537a01b-9fb3-4067-9914-50ce542214eb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089946 Sep 24 19:48:33.474293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 298/551] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:48:33 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:33.729098 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:33.730176 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:33.739403 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:33.740306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:33.741587 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:33.742996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:33.743932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:33.744384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:33.749931 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:33.916883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:33.937639 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:33.939390 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:33.940672 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e4196546-b13b-4d3d-9b88-3f93d4a893d1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1809 microversion: 2.20 time: 0.216797 Sep 24 19:48:33.941648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 254/552] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:33 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:34.313184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:34.314331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:34.322495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:34.323155 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:34.329562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:34.330444 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:34.333096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:34.333554 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:34.505206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:34.512880 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:34.515760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-18b8d9bd-18cf-4cbe-8980-f38343f9c361 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.206417 Sep 24 19:48:34.530699 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 299/553] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:34 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:34.530975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:34.538722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:34.539273 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:34.540371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:34.541080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:34.541549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:34.541974 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:34.576680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6e787ad3-2f84-40c8-b7d8-097f830f72cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084813 Sep 24 19:48:34.577263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 255/554] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:48:34 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:34.968025 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:34.969026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:34.977234 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:34.977885 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:34.978373 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:34.979162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:34.979734 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:34.980205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.136692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:35.146193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:35.147208 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:35.148449 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7c00830b-b30c-4e3d-be34-018d147ff95b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1796 microversion: 2.20 time: 0.185496 Sep 24 19:48:35.152056 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 300/555] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:48:34 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1796 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:48:35.546257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:35.546933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:35.553646 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.554370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.554948 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.556021 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.556755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.557421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.592041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:35.595995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:35.604436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.606392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.607813 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.609073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.609965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.611003 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.668147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-84e5945a-0ffc-427b-94a3-d6c074c4b88c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082367 Sep 24 19:48:35.672759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 301/556] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:48:35 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:48:35.730685 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:35.753293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f7f6a769-fd1a-4306-94ed-9d792b4e1d23 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.211023 Sep 24 19:48:35.753521 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:35.753872 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 256/557] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:35 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:35.763821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:35.763821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.763821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.763821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.764216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.764216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.764366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.795870 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:48:35.890661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-631dc388-0508-4e6b-838d-09a24b06b88f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 204 len: 0 microversion: 2.1 time: 0.140715 Sep 24 19:48:35.891171 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 302/558] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:48:35 2022] DELETE /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 19:48:35.901118 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:35.902152 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:35.904096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:35.910102 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.910879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.911583 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:35.912508 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:35.912985 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:35.913418 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:36.089272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:36.098127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-03e2045b-4f39-4737-a57d-f962f7da0937 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1681 microversion: 2.1 time: 0.201952 Sep 24 19:48:36.099197 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 257/559] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:35 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:36.779665 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:36.780381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:36.791180 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:36.792019 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:36.792560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:36.793310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:36.793984 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:36.795226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:37.020970 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:37.023379 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:37.042516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b04579e9-9754-40ec-86b9-0bc45b55fe80 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.265245 Sep 24 19:48:37.059274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 303/560] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:36 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:37.122815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:37.123604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:37.132260 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:37.132767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:37.133742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:37.134762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:37.135230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:37.135702 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:37.275576 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:37.308834 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e5cdad49-bc15-476d-afe5-c0d344f424af tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1681 microversion: 2.1 time: 0.188872 Sep 24 19:48:37.310677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 258/561] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:37 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:38.077266 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:38.077920 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:38.094154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:38.094752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:38.095269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:38.097832 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:38.098417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:38.098961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:38.282630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:38.293415 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-63a65184-48fc-4abb-b9d3-829e13b43959 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.229536 Sep 24 19:48:38.308647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 304/562] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:38 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:38.339519 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:38.341514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:38.361902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:38.362857 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:38.364518 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:38.366486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:38.369103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:38.370294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:38.569581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:38.582268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-59b13da2-03e3-4a3d-9381-4522a717b214 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1681 microversion: 2.1 time: 0.251115 Sep 24 19:48:38.583184 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 259/563] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:38 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:39.320217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:39.321895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:39.337408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:39.339417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:39.344043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:39.345616 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:39.346383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:39.347032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:39.589761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:39.605081 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4f072421-5bab-448e-ace1-95c8c06afc45 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.289870 Sep 24 19:48:39.607251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:39.608516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:39.616403 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:39.617200 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:39.617925 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:39.618893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:39.619522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 305/564] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:39 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:39.620284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:39.620936 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:39.692532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:39.703592 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1157c8f8-1843-44a0-9a1e-00107cbd5331 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1613 microversion: 2.1 time: 0.099648 Sep 24 19:48:39.704582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 260/565] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:39 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:39.822352 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-33679c49-9f61-41b1-9e14-d6e5b7b9e843 req-5278ee52-6642-4020-be7b-323406249f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80229451-4d17-4bee-9b50-a0cc56402c62", "name": "network-vif-deleted", "tag": "1cf67c9e-a9bb-4997-90fc-1e81d09b909e"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:39.834411 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-33679c49-9f61-41b1-9e14-d6e5b7b9e843 req-5278ee52-6642-4020-be7b-323406249f32 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:39.835640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-33679c49-9f61-41b1-9e14-d6e5b7b9e843 req-5278ee52-6642-4020-be7b-323406249f32 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:39.836557 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-33679c49-9f61-41b1-9e14-d6e5b7b9e843 req-5278ee52-6642-4020-be7b-323406249f32 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:39.851559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-33679c49-9f61-41b1-9e14-d6e5b7b9e843 req-5278ee52-6642-4020-be7b-323406249f32 service nova] Creating event network-vif-deleted:1cf67c9e-a9bb-4997-90fc-1e81d09b909e for instance 80229451-4d17-4bee-9b50-a0cc56402c62 on hv-cinder-85919 Sep 24 19:48:39.858729 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-33679c49-9f61-41b1-9e14-d6e5b7b9e843 req-5278ee52-6642-4020-be7b-323406249f32 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044164 Sep 24 19:48:39.859348 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 306/566] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:40.270725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7f744f5-dba7-43da-9bb6-6f92219cf0b9"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:40.273159 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:40.296224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:40.297050 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:40.301342 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:40.309014 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:40.322723 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:40.323306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:40.635781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:40.636651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:40.653675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:40.654516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:40.655378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:40.660101 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:40.660815 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:40.661470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:40.904465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:40.934092 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7beb810b-b3aa-4c9c-b7bf-d77398182842 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.304632 Sep 24 19:48:40.952473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 307/567] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:40 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:40.965220 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:40.966589 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:40.974205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:40.974869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:40.975345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:40.976139 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:40.976844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:40.977927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:41.035692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:41.036210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:41.036659 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:41.037138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lazy-loading 'fault' on Instance uuid 80229451-4d17-4bee-9b50-a0cc56402c62 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:48:41.092038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:41.100169 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b821c769-e060-4c49-9281-4708793d57cb tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 200 len: 1331 microversion: 2.1 time: 0.146389 Sep 24 19:48:41.103904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 308/568] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:40 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:41.139234 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-94407994-0924-44da-97c5-92bd432bba0a tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872548 Sep 24 19:48:41.147367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 261/569] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:48:40 2022] POST /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:41.966317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:41.966944 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:41.973437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:41.973923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:41.974361 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:41.975071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:41.975555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:41.976017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:42.130365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:42.132318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:42.141201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:42.142641 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:42.143308 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:42.144343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:42.145035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:42.145686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:42.162683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 HTTP/1.1 Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:48:42.165678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:48:42.167131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '80229451-4d17-4bee-9b50-a0cc56402c62'} Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:48:42.167902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:48:42.169470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:48:42.172792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:48:42.175173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b8c02941-c8d7-427e-9543-fa4790e88e97 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 404 len: 111 microversion: 2.1 time: 0.049779 Sep 24 19:48:42.176358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 262/570] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:42 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:48:42.186020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7eb9cc0c-d459-47ad-963b-bc49e22bd7ed tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '.version_select at 0x7f5417cfb670>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:42.192566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:42.203556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-abc84ce1-6dc0-4297-97d4-bd282dc66819 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.241067 Sep 24 19:48:42.213653 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 309/571] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:41 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:42.233994 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7eb9cc0c-d459-47ad-963b-bc49e22bd7ed tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707458177" status: 202 len: 0 microversion: 2.1 time: 0.052169 Sep 24 19:48:42.235244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 263/572] 10.222.0.55 () {58 vars in 1221 bytes} [Sat Sep 24 19:48:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707458177 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 19:48:42.993194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6b64efa1-62e1-4e32-a067-a154f52a250d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: .version_select at 0x7f5417b0d550>, body: {"keypair": {"name": "tempest-keypair-1332244171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsbwkTXvsgpfeINJC0z4eJtb9R8vO8cquIOvR1UKyyzvQb+gSAEOqrVr9Iqjg9gLJALB3GtGoMvdKQJM2In1aahe9qKMy8Y/Sym20RJJhP9cO0i+RhigphCoYcpZiunTQ=="}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:43.012301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-6b64efa1-62e1-4e32-a067-a154f52a250d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:48:43.016283 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-6b64efa1-62e1-4e32-a067-a154f52a250d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:48:43.041201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6b64efa1-62e1-4e32-a067-a154f52a250d tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052782 Sep 24 19:48:43.041630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 310/573] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:48:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:43.297906 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:43.299072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:43.317756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:43.318553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:43.319171 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:43.320104 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:43.321290 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:43.321961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:43.606056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:43.622204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b12406b1-bba8-4cd3-816a-b923ad6a20af tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.329937 Sep 24 19:48:43.622845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 264/574] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:43 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:44.650946 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:44.651761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:44.653894 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:44.660511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:44.661033 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:44.661516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:44.662259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:44.662721 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:44.663147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:44.664630 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-129530092", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccacbae6-4eff-4b60-b850-003263f855e0"}], "security_groups": [{"name": "tempest-securitygroup--1452719624"}], "key_name": "tempest-keypair-1332244171", "user_data": "}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:44.782163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] validate_networks() for [('ccacbae6-4eff-4b60-b850-003263f855e0', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:48:44.816716 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:44.825731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-92e9b318-3aca-4405-bc9b-7c0f3f945a18 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1756 microversion: 2.1 time: 0.180185 Sep 24 19:48:44.826401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 311/575] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:44 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:44.960353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:44.960851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:44.967355 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:44.967882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:44.968327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:44.969035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:44.969494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:44.969927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:45.053395 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lazy-loading 'services' on Instance uuid 9c0ca8da-4101-49bb-8747-b834c6555edd {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:48:45.127836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3bcd3987-9c79-4be8-ab88-59cb2b0bdea7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-volume_attachments/7aa53a43-857c-4053-9395-08f1e4d4dbc4" status: 202 len: 0 microversion: 2.1 time: 0.171276 Sep 24 19:48:45.128576 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 312/576] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:48:44 2022] DELETE /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-volume_attachments/7aa53a43-857c-4053-9395-08f1e4d4dbc4 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 19:48:45.160203 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:48:45.161051 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:48:45.161596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:48:45.162136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:48:45.163115 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:48:45.172127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:45.172613 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:45.173051 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:45.173774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:45.174370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:45.174800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:45.192069 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:48:45.196629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:48:45.207618 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:48:45.209906 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:48:45.258726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-dadcb164-9067-43f9-91ae-e1f3427eadee tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598819 Sep 24 19:48:45.259518 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 265/577] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:48:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 19:48:45.275293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f264015e-40a1-4deb-a92e-70a9a296077f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:45.275819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f264015e-40a1-4deb-a92e-70a9a296077f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:45.349927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f264015e-40a1-4deb-a92e-70a9a296077f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:45.373470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f264015e-40a1-4deb-a92e-70a9a296077f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1241 microversion: 2.1 time: 0.087131 Sep 24 19:48:45.375115 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 313/578] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:45 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:45.851113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:45.852564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:45.863504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:45.864058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:45.864506 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:45.865215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:45.865710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:45.866143 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:46.040217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:46.048928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-33a82124-3a28-4ec3-95ed-c0cb17d7acbc tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1759 microversion: 2.1 time: 0.202564 Sep 24 19:48:46.049498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 266/579] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:45 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1759 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:46.398101 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:46.399667 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:46.408418 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:46.408956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:46.409432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:46.410228 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:46.410745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:46.411246 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:46.478292 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:46.486098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-51e7fe68-1ec6-4457-94be-a6a4fc4bab80 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1293 microversion: 2.1 time: 0.092490 Sep 24 19:48:46.486656 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 314/580] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:46 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:47.510866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:47.512943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:47.522856 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:47.524078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:47.524891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:47.525802 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:47.526521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:47.527115 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:47.807682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:47.816033 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-35728f68-16fa-46a4-97dc-099502d50179 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.310727 Sep 24 19:48:47.816922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 267/581] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:47 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:48.525904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-168c134f-20de-4a7e-a08a-b1d779266b6d req-e6b05196-ce78-49f8-94f3-fa3736b744aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee50330a-a26e-440d-9b04-4eddbbb417f9", "tag": "f6946e56-e3ff-4aca-9ce2-47ef56094c82"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:48.536501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-168c134f-20de-4a7e-a08a-b1d779266b6d req-e6b05196-ce78-49f8-94f3-fa3736b744aa service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:48.536987 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-168c134f-20de-4a7e-a08a-b1d779266b6d req-e6b05196-ce78-49f8-94f3-fa3736b744aa service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:48.537419 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-168c134f-20de-4a7e-a08a-b1d779266b6d req-e6b05196-ce78-49f8-94f3-fa3736b744aa service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:48.550112 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-168c134f-20de-4a7e-a08a-b1d779266b6d req-e6b05196-ce78-49f8-94f3-fa3736b744aa service nova] Creating event network-changed:f6946e56-e3ff-4aca-9ce2-47ef56094c82 for instance ee50330a-a26e-440d-9b04-4eddbbb417f9 on hv-cinder-85919 Sep 24 19:48:48.555850 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-168c134f-20de-4a7e-a08a-b1d779266b6d req-e6b05196-ce78-49f8-94f3-fa3736b744aa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Sep 24 19:48:48.556790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 315/582] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:48.779479 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:48.782513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:48.793628 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:48.794389 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:48.795288 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:48.796080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:48.796561 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:48.796993 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:48.823897 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lazy-loading 'flavor' on Instance uuid f81c1923-5243-4247-aee6-805f902927ca {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:48:48.841087 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:48.841792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:48.855909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:48.856425 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:48.856876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:48.857599 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:48.858061 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:48.858501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:49.016267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b9f76292-d8e1-4661-9d10-c13dd2b15836 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/action" status: 200 len: 32 microversion: 2.1 time: 0.243288 Sep 24 19:48:49.016878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 268/583] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:48:48 2022] POST /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 19:48:49.026842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:49.027622 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:49.034051 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:49.034548 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:49.034988 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:49.035718 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:49.036181 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:49.036612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:49.145809 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:49.155874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-298e208b-15d4-4c23-bc8b-b4ac068477ce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.319350 Sep 24 19:48:49.157412 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 316/584] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:48 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:49.264544 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:49.267113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:49.275418 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5c6aad2d-0dcd-4283-baed-7d333bd07c92 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.252755 Sep 24 19:48:49.292335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 269/585] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:49 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:49.477102 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d4a5c426-8a5f-462f-b45e-f66b34d18b2a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:49.485212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a5c426-8a5f-462f-b45e-f66b34d18b2a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:49.485804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a5c426-8a5f-462f-b45e-f66b34d18b2a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:49.486549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a5c426-8a5f-462f-b45e-f66b34d18b2a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:49.552220 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d4a5c426-8a5f-462f-b45e-f66b34d18b2a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Going to try to stop instance {{(pid=127045) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 19:48:49.599816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d4a5c426-8a5f-462f-b45e-f66b34d18b2a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action" status: 202 len: 0 microversion: 2.1 time: 0.127365 Sep 24 19:48:49.600414 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 317/586] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:48:49 2022] POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:48:49.609816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:49.610933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:49.618540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:49.619730 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:49.620569 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:49.621757 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:49.622722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:49.623554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:49.839206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:49.850557 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-43ae26d8-a605-45da-b644-02d09da5329f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.245504 Sep 24 19:48:49.851148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 270/587] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:49 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:50.184825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:50.185594 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:50.191703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:50.192195 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:50.193259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:50.193960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:50.194422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:50.194851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:50.317289 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:50.318013 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:50.325339 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:50.325339 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:50.325740 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:50.326448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:50.326909 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:50.327367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:50.424603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:50.432931 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-57c1e683-a2f8-4adb-82e7-3ce7a429e4cc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.253078 Sep 24 19:48:50.433757 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 318/588] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:50 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:50.467039 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:50.480900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-95e5c83d-abba-4a42-80ee-47924a6c8558 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.163092 Sep 24 19:48:50.480900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 271/589] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:50 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:50.874681 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:50.875214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:50.881305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:50.881794 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:50.882263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:50.883607 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:50.884071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:50.884503 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:51.019346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:51.027222 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d3ea3d00-286c-4906-a6c9-a7b5be27c7e7 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.156562 Sep 24 19:48:51.027848 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 319/590] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:50 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:51.456823 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:51.457440 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:51.464681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:51.465342 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:51.465790 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:51.466484 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:51.466948 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:51.467378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:51.500202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:51.500913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:51.508598 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:51.509121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:51.509671 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:51.510445 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:51.510997 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:51.511481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:51.596331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:51.604770 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a27f5e29-eb4c-410b-a137-146cf1bc4999 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.151866 Sep 24 19:48:51.605344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 272/591] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:51 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:51.746735 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:51.756907 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d5b5f0b4-3ad5-4a0c-8e52-84b67e7bc086 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.260993 Sep 24 19:48:51.757357 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 320/592] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:51 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:52.051304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:52.052123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:52.059071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:52.060265 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:52.060943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:52.061776 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:52.062648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:52.063208 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:52.219448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:52.228191 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-12802df0-6c5a-49e3-96db-67e476d23ef3 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.180934 Sep 24 19:48:52.229478 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 273/593] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:52 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:52.629049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:52.630556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:52.639213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:52.639761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:52.640386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:52.641146 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:52.641617 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:52.642049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:52.780087 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:52.781040 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:52.787576 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:52.788042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:52.789315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:52.790018 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:52.791097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:52.791628 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:52.798626 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:52.801250 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:52.810505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2e997896-84eb-4449-9369-4feba3703751 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.185985 Sep 24 19:48:52.811116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 321/594] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:52 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:52.922840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:52.931824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a5115e9e-f8a6-4cf4-90ac-ec0582007816 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.155931 Sep 24 19:48:52.932383 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 274/595] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:52 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:53.252926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:53.253539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:53.260445 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:53.260935 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:53.261376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:53.262076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:53.262528 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:53.262965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:53.395086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:53.403393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-bf6b430e-5002-4d7f-90ca-d08478578cf2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.154344 Sep 24 19:48:53.403979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 322/596] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:53 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:53.837533 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:53.838134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:53.844777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:53.845268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:53.845737 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:53.846467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:53.846933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:53.847393 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:53.955496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:53.956538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:53.965179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:53.965814 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:53.966355 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:53.967316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:53.968026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:53.968613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:53.983116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:53.993217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-87877ea6-d64b-48a3-88ef-d7753e9de97e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.159539 Sep 24 19:48:53.994001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 275/597] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:53 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:54.107465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:54.115796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5a3baaed-1ee2-4dee-9042-0e763e31c637 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.165269 Sep 24 19:48:54.116365 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 323/598] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:53 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:54.135958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-0fb0e79d-874d-4ff7-8799-3023884c9016 req-659d86ce-9037-4929-aa62-08d8826a0da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee50330a-a26e-440d-9b04-4eddbbb417f9", "name": "network-vif-plugged", "status": "completed", "tag": "f6946e56-e3ff-4aca-9ce2-47ef56094c82"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:54.145365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-0fb0e79d-874d-4ff7-8799-3023884c9016 req-659d86ce-9037-4929-aa62-08d8826a0da9 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:54.145841 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-0fb0e79d-874d-4ff7-8799-3023884c9016 req-659d86ce-9037-4929-aa62-08d8826a0da9 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:54.146276 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-0fb0e79d-874d-4ff7-8799-3023884c9016 req-659d86ce-9037-4929-aa62-08d8826a0da9 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:54.157194 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-0fb0e79d-874d-4ff7-8799-3023884c9016 req-659d86ce-9037-4929-aa62-08d8826a0da9 service nova] Creating event network-vif-plugged:f6946e56-e3ff-4aca-9ce2-47ef56094c82 for instance ee50330a-a26e-440d-9b04-4eddbbb417f9 on hv-cinder-85919 Sep 24 19:48:54.162072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-0fb0e79d-874d-4ff7-8799-3023884c9016 req-659d86ce-9037-4929-aa62-08d8826a0da9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029964 Sep 24 19:48:54.162663 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 276/599] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:48:54.427160 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:54.427919 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:54.434741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:54.435242 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:54.435690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:54.436409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:54.436877 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:54.437274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:54.566625 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:54.576530 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e00a1951-62bd-43b6-88c3-1e906776dc73 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.153369 Sep 24 19:48:54.577108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 324/600] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:54 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:55.018542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:55.019245 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:55.025439 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:55.025923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:55.026361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:55.027056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:55.027555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:55.027983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:55.139945 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:55.140665 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:55.147060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:55.147678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:55.148207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:55.148965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:55.149422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:55.149849 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:55.159321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:55.167316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-762db38d-395a-4545-bc1b-3e5d6f88569f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.153506 Sep 24 19:48:55.167926 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 277/601] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:55 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:55.277499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:55.285710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c9cd5818-244d-4887-b642-c61a6404a1d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.149637 Sep 24 19:48:55.286368 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 325/602] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:55 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:55.600869 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:55.603291 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:55.606763 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:55.608035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=6 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:55.616380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:55.616997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:55.617498 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:55.618329 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:55.618894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:55.619398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:55.753075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:55.760903 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-78ed7301-e692-473b-805b-2bbd46150282 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.164024 Sep 24 19:48:55.761460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 278/603] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:55 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:56.190657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:56.191265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:56.193133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:48:56.199485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:56.199982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:56.200422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:56.201123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:56.201585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:56.202013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:56.311020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:56.311749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:56.319263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:56.319793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:56.320891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:56.321811 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:56.322279 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:56.322712 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:56.335513 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:56.344149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-74d3280a-ab3b-4565-a6d3-3d1d38a82496 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1367 microversion: 2.1 time: 0.157362 Sep 24 19:48:56.344975 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 326/604] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:56 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:56.466355 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:56.474795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5deb2191-288e-4621-9177-07a61dbb0471 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.168110 Sep 24 19:48:56.475354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 279/605] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:56 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:56.784389 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:56.784934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:56.791539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:56.792030 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:56.792474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:56.793171 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:56.793639 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:56.794076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:56.921706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:56.929344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-82f7fb16-8e31-4fb5-8fe5-3b2fbcf30093 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.148900 Sep 24 19:48:56.930471 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 327/606] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:56 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:57.368405 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:57.369000 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:57.375554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.376038 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.376479 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:57.377170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.377632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.378055 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:57.499017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:57.499690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:57.504846 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:57.506066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.506559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.507001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:57.508255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.508852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.509292 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:57.513336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-409cd219-1e6a-4a52-815c-0937c15c2f9b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1558 microversion: 2.1 time: 0.149450 Sep 24 19:48:57.513908 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 280/607] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:57 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:57.536280 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:57.536863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:57.543271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.543809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.544540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:57.545406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.545869 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.546296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:57.622319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-80a58a69-677f-471e-857b-82f3c7c31d40 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089835 Sep 24 19:48:57.623001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 281/608] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:48:57 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:48:57.641074 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:57.650032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2c8027ee-e7b1-4900-801d-1dcc4e5d03ca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.155070 Sep 24 19:48:57.650795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 328/609] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:57 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:48:57.953153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:57.953777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:57.959815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.960313 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.960820 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:57.961531 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:57.961993 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:57.962472 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:58.394032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:58.402354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-dabefa80-cd14-4a63-8ec7-3d7bda9e6d8e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.453099 Sep 24 19:48:58.403097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 282/610] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:57 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:58.673409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:58.674019 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:58.681104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:58.681658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:58.682168 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:58.682950 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:58.683504 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:58.683990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:58.821154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:58.830402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8981002e-82fa-4304-bf4f-142a45ef7fe3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.161094 Sep 24 19:48:58.831175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 329/611] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:58 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:58.850922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-9eed7ab8-dbdb-4e09-a596-5507d04b4076 req-ef289856-c829-4766-bc7a-f3a64282634a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee50330a-a26e-440d-9b04-4eddbbb417f9", "tag": "f6946e56-e3ff-4aca-9ce2-47ef56094c82"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:48:58.861002 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9eed7ab8-dbdb-4e09-a596-5507d04b4076 req-ef289856-c829-4766-bc7a-f3a64282634a service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:58.861474 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9eed7ab8-dbdb-4e09-a596-5507d04b4076 req-ef289856-c829-4766-bc7a-f3a64282634a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:58.861905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9eed7ab8-dbdb-4e09-a596-5507d04b4076 req-ef289856-c829-4766-bc7a-f3a64282634a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:58.873765 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-9eed7ab8-dbdb-4e09-a596-5507d04b4076 req-ef289856-c829-4766-bc7a-f3a64282634a service nova] Creating event network-changed:f6946e56-e3ff-4aca-9ce2-47ef56094c82 for instance ee50330a-a26e-440d-9b04-4eddbbb417f9 on hv-cinder-85919 Sep 24 19:48:58.878799 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-9eed7ab8-dbdb-4e09-a596-5507d04b4076 req-ef289856-c829-4766-bc7a-f3a64282634a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034922 Sep 24 19:48:58.879394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 283/612] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:48:59.426776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:59.427403 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:59.434525 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:59.434946 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:59.435386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:59.436307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:59.436774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:59.437199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:59.575891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:48:59.585048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a75e08ac-9b95-4647-8529-66b77686612d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1679 microversion: 2.1 time: 0.162586 Sep 24 19:48:59.585819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 330/613] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:59 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:48:59.856024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:48:59.856705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:48:59.862951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:59.863467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:59.863924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:59.864632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:48:59.865128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:48:59.865560 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:48:59.997888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:00.006083 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2f0a573e-c4d4-40cd-8542-122d993fabfa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.155603 Sep 24 19:49:00.006640 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 284/614] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:48:59 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:00.608981 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:00.609633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:00.616527 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:00.617143 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:00.617928 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:00.619170 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:00.620051 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:00.620767 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:00.752110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:00.760500 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-32bd35bd-63af-48c7-a94f-ca213b36ec6d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1656 microversion: 2.1 time: 0.155759 Sep 24 19:49:00.761074 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 331/615] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:00 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:00.786908 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a6a66e65-eb04-4e51-8e65-2024b077d7d9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:00.793157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6a66e65-eb04-4e51-8e65-2024b077d7d9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:00.793639 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6a66e65-eb04-4e51-8e65-2024b077d7d9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:00.794076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a6a66e65-eb04-4e51-8e65-2024b077d7d9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:00.817285 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a6a66e65-eb04-4e51-8e65-2024b077d7d9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Going to try to start instance {{(pid=127046) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 19:49:00.859799 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a6a66e65-eb04-4e51-8e65-2024b077d7d9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action" status: 202 len: 0 microversion: 2.1 time: 0.076480 Sep 24 19:49:00.860471 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 285/616] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:49:00 2022] POST /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:49:00.869123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:00.869921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:00.875839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:00.876325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:00.876770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:00.877536 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:00.877943 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:00.878396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:01.029531 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:01.030267 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:01.035690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:01.036716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:01.037212 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:01.037653 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:01.038361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:01.038823 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:01.039251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:01.044596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-138b87eb-8c01-449b-abe8-aaa25154a043 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1665 microversion: 2.1 time: 0.179742 Sep 24 19:49:01.045275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 332/617] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:00 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:01.177883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:01.186943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-11c9b796-a5dd-4de0-aa70-113b1a720474 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.161664 Sep 24 19:49:01.187540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 286/618] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:01 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:49:02.070032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:02.070763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:02.079044 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:02.079737 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:02.080457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:02.081581 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:02.082116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:02.082603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:02.209598 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:02.210213 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:02.216780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:02.217274 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:02.217750 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:02.218458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:02.218925 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:02.219387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:02.222091 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:02.222238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:02.231625 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a2ac940c-2ef3-4906-b4c6-72c8c01b04bd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1665 microversion: 2.1 time: 0.165373 Sep 24 19:49:02.232204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 333/619] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:02 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1665 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:02.351810 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:02.360611 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f0ab917a-e8ba-4852-8462-92ca26ed6535 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.154991 Sep 24 19:49:02.361178 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 287/620] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:02 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:49:03.256320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:03.256928 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:03.264028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:03.264559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:03.265000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:03.265804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:03.266381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:03.266838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:03.385345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:03.385949 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:03.392735 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:03.393224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:03.393660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:03.394358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:03.394817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:03.395242 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:03.401564 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:03.407512 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6e06a74a-964c-4ad3-a5c1-0d2ffe2638a4 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1669 microversion: 2.1 time: 0.155612 Sep 24 19:49:03.408082 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 334/621] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:03 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:03.540182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:03.548816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c410ac7d-4b77-4ad8-a517-4355832616f7 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.168226 Sep 24 19:49:03.549373 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 288/622] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:03 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:49:04.572011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:04.572766 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:04.579068 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:04.579591 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:04.580030 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:04.580724 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:04.581216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:04.581643 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:04.708543 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:04.717629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-15161448-ae84-4f67-bba9-2c4ef1509650 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.149580 Sep 24 19:49:04.718197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 335/623] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:04 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:05.741409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:05.742026 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:05.749437 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:05.749927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:05.750367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:05.751064 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:05.751549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:05.751996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:05.882891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:05.891034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-46a900ae-8b46-459d-9a97-7d681fef32a2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.153493 Sep 24 19:49:05.891610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 289/624] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:05 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:06.913763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:06.914383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:06.921258 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:06.921758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:06.922204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:06.922912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:06.923688 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:06.924121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:07.051134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:07.060058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c9ee2de7-8015-44e7-b634-f5170b682655 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.150105 Sep 24 19:49:07.060634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 336/625] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:06 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:08.085108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:08.085871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:08.089893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:08.094423 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:08.094916 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:08.095356 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:08.096103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:08.096610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:08.097072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:08.225057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:08.233534 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bdb0a444-d45e-45c5-a35a-1513401d855d tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1735 microversion: 2.1 time: 0.152570 Sep 24 19:49:08.234105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 290/626] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:08 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:09.257197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:09.257786 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:09.264317 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.264797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.265226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.265913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.266370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.266794 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.397964 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:09.406553 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-19fa174b-1b21-42f5-897b-a7768a1e70d0 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1715 microversion: 2.1 time: 0.153224 Sep 24 19:49:09.407112 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 337/627] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:09 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:09.515262 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:09.515792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:09.522170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.522663 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.523139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.523880 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.524352 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.525394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.651706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] HTTP exception thrown: Cannot 'detach_volume' instance f81c1923-5243-4247-aee6-805f902927ca while it is in vm_state rescued Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Request method failure captured: Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: DELETE /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments/b7f744f5-dba7-43da-9bb6-6f92219cf0b9 HTTP/1.1 Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL144Co_KYV-KP0xPXbouvg98k2x3g34lAIMyI70xmmjXTgvwWCHJd0_jdF8LSgviKk2jF6tlX0pyXrudOUvOaHHPsytvnECLiNmgk2Wdx9PSH6ZiD_rpfPYCHphy5NXskDwR5s0-Y2b8_i-d5i6VrWEU4EKOAfPNzv2JMLiDfba29Qc Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:49:09.653370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: f417a94fed274bfbb88d23677a4877a7 Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:49:09.654907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Cannot 'detach_volume' instance f81c1923-5243-4247-aee6-805f902927ca while it is in vm_state rescued Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'server_id': 'f81c1923-5243-4247-aee6-805f902927ca', 'id': 'b7f744f5-dba7-43da-9bb6-6f92219cf0b9'} Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f81c1923-5243-4247-aee6-805f902927ca in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:49:09.655716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f81c1923-5243-4247-aee6-805f902927ca while it is in vm_state rescued Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f81c1923-5243-4247-aee6-805f902927ca while it is in vm_state rescued Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:09.657114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Returning 409 to user: Cannot 'detach_volume' instance f81c1923-5243-4247-aee6-805f902927ca while it is in vm_state rescued {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:49:09.658242 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-573293b2-dae5-4186-b86f-673f5b30c08c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments/b7f744f5-dba7-43da-9bb6-6f92219cf0b9" status: 409 len: 152 microversion: 2.1 time: 0.143660 Sep 24 19:49:09.658242 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 291/628] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:49:09 2022] DELETE /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments/b7f744f5-dba7-43da-9bb6-6f92219cf0b9 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 19:49:09.663683 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:09.664213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:09.670385 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.670869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.671307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.672022 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.672484 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.672904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.686479 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:09.739433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-171e5208-64a1-4276-8bad-ecb47bc68baa tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "POST /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/action" status: 202 len: 0 microversion: 2.1 time: 0.079110 Sep 24 19:49:09.740322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 338/629] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:49:09 2022] POST /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:49:09.748845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:09.749463 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:09.756133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.756579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.757029 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.757749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:09.758214 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:09.758650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:09.893419 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:09.901655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4561eaec-48c8-45b3-8430-c0a2302631d9 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1723 microversion: 2.1 time: 0.156650 Sep 24 19:49:09.902208 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 292/630] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:09 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:10.925930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:10.926649 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:10.933424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:10.933915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:10.934364 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:10.935065 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:10.935590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:10.936028 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:11.064650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:11.073341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-474882f1-32d9-4cb2-a15a-dd15524703ae tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1723 microversion: 2.1 time: 0.151934 Sep 24 19:49:11.073936 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 339/631] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:10 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:12.097203 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:12.097821 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:12.105321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:12.105810 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:12.106257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:12.106962 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:12.107449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:12.107887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:12.236338 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:12.245043 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a49f5555-7cdf-486f-9524-c70a6be4b149 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1723 microversion: 2.1 time: 0.151733 Sep 24 19:49:12.245613 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 293/632] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:12 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:13.268486 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:13.269087 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:13.276700 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:13.277194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:13.277641 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:13.278349 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:13.278818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:13.279258 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:13.404511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:13.412586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-67b2ae91-e45b-4db4-a5fe-7dca6b4153c8 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1729 microversion: 2.1 time: 0.148095 Sep 24 19:49:13.413140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 340/633] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:13 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:13.435219 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:13.435780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:13.442009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:13.442491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:13.442927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:13.443643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:13.444125 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:13.444548 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:13.519479 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cd5b3295-61dc-4150-9276-f9a01315fbf4 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088276 Sep 24 19:49:13.520078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 294/634] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:49:13 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:14.408614 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-ec9723af-ebf3-45b8-b395-68bf7fe81ad2 req-a6292186-663a-48a2-899d-ebff2db4c670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81c1923-5243-4247-aee6-805f902927ca", "tag": "844ee860-c3c3-460e-87aa-ab602ef8bf67"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:14.420437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ec9723af-ebf3-45b8-b395-68bf7fe81ad2 req-a6292186-663a-48a2-899d-ebff2db4c670 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:14.420928 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ec9723af-ebf3-45b8-b395-68bf7fe81ad2 req-a6292186-663a-48a2-899d-ebff2db4c670 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:14.421369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ec9723af-ebf3-45b8-b395-68bf7fe81ad2 req-a6292186-663a-48a2-899d-ebff2db4c670 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:14.433366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-ec9723af-ebf3-45b8-b395-68bf7fe81ad2 req-a6292186-663a-48a2-899d-ebff2db4c670 service nova] Creating event network-changed:844ee860-c3c3-460e-87aa-ab602ef8bf67 for instance f81c1923-5243-4247-aee6-805f902927ca on hv-cinder-85919 Sep 24 19:49:14.438132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-ec9723af-ebf3-45b8-b395-68bf7fe81ad2 req-a6292186-663a-48a2-899d-ebff2db4c670 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033404 Sep 24 19:49:14.438720 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 341/635] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:16.452830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-2052ba5d-b0df-4cf5-ab00-d9006fdf8cb8 req-14ba4ac6-62f9-4a86-9ae4-3b2780eed19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81c1923-5243-4247-aee6-805f902927ca", "tag": "844ee860-c3c3-460e-87aa-ab602ef8bf67"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:16.462144 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2052ba5d-b0df-4cf5-ab00-d9006fdf8cb8 req-14ba4ac6-62f9-4a86-9ae4-3b2780eed19f service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:16.462665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2052ba5d-b0df-4cf5-ab00-d9006fdf8cb8 req-14ba4ac6-62f9-4a86-9ae4-3b2780eed19f service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:16.463103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2052ba5d-b0df-4cf5-ab00-d9006fdf8cb8 req-14ba4ac6-62f9-4a86-9ae4-3b2780eed19f service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:16.473981 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-2052ba5d-b0df-4cf5-ab00-d9006fdf8cb8 req-14ba4ac6-62f9-4a86-9ae4-3b2780eed19f service nova] Creating event network-changed:844ee860-c3c3-460e-87aa-ab602ef8bf67 for instance f81c1923-5243-4247-aee6-805f902927ca on hv-cinder-85919 Sep 24 19:49:16.479414 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-2052ba5d-b0df-4cf5-ab00-d9006fdf8cb8 req-14ba4ac6-62f9-4a86-9ae4-3b2780eed19f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030864 Sep 24 19:49:16.480139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 295/636] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:23.285606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:23.286201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:23.288162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=64 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:23.293652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:23.294398 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:23.294841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:23.295562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:23.296023 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:23.296460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:23.325183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e2a35224-51bf-49b6-8d55-ed7be8b43d49 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments/75292efa-5602-4b13-89b7-c705499c69a1" status: 200 len: 194 microversion: 2.20 time: 0.044704 Sep 24 19:49:23.326284 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 342/637] 10.222.0.55 () {60 vars in 1454 bytes} [Sat Sep 24 19:49:23 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments/75292efa-5602-4b13-89b7-c705499c69a1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:49:23.397050 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:23.397644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:23.404266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:23.404764 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:23.405212 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:23.405914 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:23.406381 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:23.406815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:23.489779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lazy-loading 'services' on Instance uuid bff567a7-861e-469a-913d-add40f3220c9 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:49:23.604537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b4f377df-10d3-4de1-8148-2e544ae2e35e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments/75292efa-5602-4b13-89b7-c705499c69a1" status: 202 len: 0 microversion: 2.20 time: 0.212027 Sep 24 19:49:23.605391 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 296/638] 10.222.0.55 () {60 vars in 1457 bytes} [Sat Sep 24 19:49:23 2022] DELETE /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments/75292efa-5602-4b13-89b7-c705499c69a1 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:49:23.615071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:23.617342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:23.624454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:23.624951 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:23.625391 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:23.626104 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:23.626566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:23.626995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:23.656552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-273b7e14-adef-48bc-ad70-87d53a60d609 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Sep 24 19:49:23.657110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 343/639] 10.222.0.55 () {60 vars in 1343 bytes} [Sat Sep 24 19:49:23 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 19:49:24.670632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:24.673313 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:24.680455 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:24.680951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:24.681385 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:24.682094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:24.682552 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:24.682980 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:24.715320 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-30ca4d27-fa25-437e-adc9-64379b51025d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049940 Sep 24 19:49:24.716561 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 297/640] 10.222.0.55 () {60 vars in 1343 bytes} [Sat Sep 24 19:49:24 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:49:25.730560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:25.732743 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:25.739097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:25.739622 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:25.740066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:25.740755 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:25.741216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:25.741642 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:25.771087 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-767577e2-6bba-4b01-94df-e6122ef9e1d7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044504 Sep 24 19:49:25.771659 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 344/641] 10.222.0.55 () {60 vars in 1343 bytes} [Sat Sep 24 19:49:25 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:25.834906 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:25.835495 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:25.841960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:25.842446 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:25.842885 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:25.843611 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:25.844078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:25.844509 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:25.869694 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:49:25.944201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-85ff7805-e2d6-4595-a40e-94a6186ad668 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 204 len: 0 microversion: 2.20 time: 0.113072 Sep 24 19:49:25.944999 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 298/642] 10.222.0.55 () {60 vars in 1280 bytes} [Sat Sep 24 19:49:25 2022] DELETE /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 19:49:25.953760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:25.954371 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:25.960558 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:25.961053 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:25.961498 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:25.962203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:25.962666 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:25.963098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:26.096818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:26.105008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:26.106449 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:26.108282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8f2eab76-742c-47b7-af6b-d87eacf68b93 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.158296 Sep 24 19:49:26.108843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 345/643] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:25 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:49:27.134755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:27.135483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:27.142664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:27.143155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:27.143633 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:27.144332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:27.144791 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:27.145219 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:27.277965 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:27.287623 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:27.289078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:27.290241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9000155e-ab8f-47d3-8788-bd9a5c663a1b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.159817 Sep 24 19:49:27.290803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 299/644] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:27 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:28.315901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:28.316547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:28.323017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:28.323536 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:28.323977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:28.324680 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:28.325142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:28.325572 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:28.777941 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:28.786118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:28.787590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:28.788751 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a46373d0-270f-4951-a829-be7e3167b9c1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1724 microversion: 2.20 time: 0.476918 Sep 24 19:49:28.789493 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 346/645] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:28 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1724 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:49:29.146540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-2bfe9656-d4ca-4db7-bc0a-fe038f05f5ad req-85f57842-4b83-4e47-bfed-9e1a81e6c400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff567a7-861e-469a-913d-add40f3220c9", "name": "network-vif-deleted", "tag": "8874d4a7-638a-44b3-b521-fda12ba4f441"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:29.158493 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2bfe9656-d4ca-4db7-bc0a-fe038f05f5ad req-85f57842-4b83-4e47-bfed-9e1a81e6c400 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:29.159015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2bfe9656-d4ca-4db7-bc0a-fe038f05f5ad req-85f57842-4b83-4e47-bfed-9e1a81e6c400 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:29.160143 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-2bfe9656-d4ca-4db7-bc0a-fe038f05f5ad req-85f57842-4b83-4e47-bfed-9e1a81e6c400 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:29.173855 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-2bfe9656-d4ca-4db7-bc0a-fe038f05f5ad req-85f57842-4b83-4e47-bfed-9e1a81e6c400 service nova] Creating event network-vif-deleted:8874d4a7-638a-44b3-b521-fda12ba4f441 for instance bff567a7-861e-469a-913d-add40f3220c9 on hv-cinder-85919 Sep 24 19:49:29.181363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-2bfe9656-d4ca-4db7-bc0a-fe038f05f5ad req-85f57842-4b83-4e47-bfed-9e1a81e6c400 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038392 Sep 24 19:49:29.182002 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 300/646] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:49:29.815994 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:29.816575 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:29.822923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:29.823439 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:29.823903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:29.824606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:29.825069 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:29.825499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:29.861114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:29.861702 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:29.862147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:29.862598 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lazy-loading 'fault' on Instance uuid bff567a7-861e-469a-913d-add40f3220c9 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:49:29.904804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:29.913228 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:29.914675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:29.915853 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f1039280-3517-4b1b-aad3-69ec146da3ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 200 len: 1372 microversion: 2.20 time: 0.103914 Sep 24 19:49:29.916403 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 347/647] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:29 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:30.946743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:30.947469 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:30.954763 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:30.955251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:30.955716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:30.956407 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:30.956864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:30.957290 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:30.970538 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] HTTP exception thrown: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Request method failure captured: Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 HTTP/1.1 Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL15BwZnLWR4lBFv1yIqac9ijLPSDz3M0gzPzALA6RIN0hgVdBp-fLTmxcKySAJ9vvEZrv_wHn7B7xLMzUIAOIsyNt-rb6_YU8RwVNv5ZXLiLJ518R57slhX_gO8fFwLhu1f0WF5r580B9NzuseHOK1sF0PiHfgzBx8DJfgquD_tfuNk Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:49:30.972193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 6974a4c8fffd4bc2933e754770cb912e Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:49:30.973817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': 'bff567a7-861e-469a-913d-add40f3220c9'} Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:49:30.974666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:49:30.975894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:30.977086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Returning 404 to user: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:49:30.977086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a32e1119-ff3d-46be-a192-becc1c253578 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 404 len: 111 microversion: 2.20 time: 0.031144 Sep 24 19:49:30.977086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 301/648] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:30 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:49:30.982427 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7946ae15-688c-4d16-ae48-d65b4ad7e2ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '.version_select at 0x7f5417a089d0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:31.001170 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7946ae15-688c-4d16-ae48-d65b4ad7e2ed tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884035641" status: 204 len: 0 microversion: 2.20 time: 0.022535 Sep 24 19:49:31.001711 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 348/649] 10.222.0.55 () {60 vars in 1262 bytes} [Sat Sep 24 19:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884035641 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 19:49:31.620150 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2aa8736b-cafe-40cf-9cfa-e2754f6522ad tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'create', calling method: .version_select at 0x7f5417cb69d0>, body: {"keypair": {"name": "tempest-keypair-530502288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZBILbJKmKX75yUJqLqU3k/yb05dq6uQ5+zTAxFKkwa9z9hR86m1v4fVt22C4OP2FaQDd9UJJPIbW6qatu/M6o9xJ8tK7/0pAVFCgSf4PQ6URRv530RNB4EUqDHcWdneA=="}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:31.635783 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-2aa8736b-cafe-40cf-9cfa-e2754f6522ad tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:49:31.639555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-2aa8736b-cafe-40cf-9cfa-e2754f6522ad tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for user 6974a4c8fffd4bc2933e754770cb912e and project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:49:31.661348 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2aa8736b-cafe-40cf-9cfa-e2754f6522ad tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044990 Sep 24 19:49:31.661936 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 302/650] 10.222.0.55 () {62 vars in 1200 bytes} [Sat Sep 24 19:49:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 19:49:32.907999 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-116464948", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27f97536-f5bb-41f3-be68-984bbab5d462"}], "security_groups": [{"name": "tempest-securitygroup--1654169371"}], "key_name": "tempest-keypair-530502288", "user_data": "}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:33.011761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] validate_networks() for [('27f97536-f5bb-41f3-be68-984bbab5d462', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:49:33.377396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:49:33.377825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:49:33.378337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:49:33.378778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:49:33.379194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:49:33.388271 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:33.389131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:33.389576 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:33.390384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:33.390852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:33.391320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:33.408743 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:49:33.412697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Getting quotas for user 6974a4c8fffd4bc2933e754770cb912e and project 3417cf79d7d748d483e8aeb8289b75f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:49:33.424785 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:49:33.427737 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:49:33.474579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-896a2449-9115-40c1-b1fa-e8bf5afdb386 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.571980 Sep 24 19:49:33.475217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 349/651] 10.222.0.55 () {62 vars in 1188 bytes} [Sat Sep 24 19:49:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 19:49:33.487350 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d3fd0ae5-bca9-441b-ac0c-76ac4c623067 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:33.488019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d3fd0ae5-bca9-441b-ac0c-76ac4c623067 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:33.547412 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d3fd0ae5-bca9-441b-ac0c-76ac4c623067 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:33.555853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d3fd0ae5-bca9-441b-ac0c-76ac4c623067 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:33.557209 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d3fd0ae5-bca9-441b-ac0c-76ac4c623067 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:33.558317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d3fd0ae5-bca9-441b-ac0c-76ac4c623067 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1280 microversion: 2.20 time: 0.075990 Sep 24 19:49:33.558866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 303/652] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:33 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:34.095204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1154829772"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:34.095833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:34.101831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:34.102322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:34.102815 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:34.103547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:34.104013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:34.104444 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:34.236494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.network.security_group_api [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Removing security group 2c8466d7-a1f7-430a-86f6-092d10bac09f from port df4d7c5e-93cd-42b9-998b-7c78ab449dc1 Sep 24 19:49:34.549736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5661dccd-6846-463d-a8b3-a249d9b54757 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/action" status: 202 len: 0 microversion: 2.1 time: 0.459628 Sep 24 19:49:34.550381 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 350/653] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:49:34 2022] POST /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:49:34.559791 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-483111d9-0593-470e-a147-bc24bea56e99 req-105baa02-f709-4720-a0e3-f7ded521ef45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241", "tag": "df4d7c5e-93cd-42b9-998b-7c78ab449dc1"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:34.570610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-483111d9-0593-470e-a147-bc24bea56e99 req-105baa02-f709-4720-a0e3-f7ded521ef45 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:34.571319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-483111d9-0593-470e-a147-bc24bea56e99 req-105baa02-f709-4720-a0e3-f7ded521ef45 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:34.571884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-483111d9-0593-470e-a147-bc24bea56e99 req-105baa02-f709-4720-a0e3-f7ded521ef45 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:34.584509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:34.585844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:34.593487 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:34.594586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:34.594819 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:34.595454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:34.597815 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:34.598829 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:34.599543 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:34.604276 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-483111d9-0593-470e-a147-bc24bea56e99 req-105baa02-f709-4720-a0e3-f7ded521ef45 service nova] Creating event network-changed:df4d7c5e-93cd-42b9-998b-7c78ab449dc1 for instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 on hv-cinder-85919 Sep 24 19:49:34.612536 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-483111d9-0593-470e-a147-bc24bea56e99 req-105baa02-f709-4720-a0e3-f7ded521ef45 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058306 Sep 24 19:49:34.613482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 304/654] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:49:34.677225 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:34.686892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:34.688376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:34.689492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4aecf9ec-144d-400b-87d7-acbcc3c97c88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1332 microversion: 2.20 time: 0.109569 Sep 24 19:49:34.690269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 351/655] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:34 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:35.717244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:35.717954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:35.725485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:35.725980 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:35.726425 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:35.727128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:35.727625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:35.728056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:35.791793 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:35.800448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:35.801918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:35.803040 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1eca7398-046d-4aa5-911e-9abf07d6ac59 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1338 microversion: 2.20 time: 0.091493 Sep 24 19:49:35.803604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 305/656] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:35 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1338 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:36.594227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:36.595631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:36.603154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:36.603998 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:36.604520 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:36.605369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:36.605834 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:36.606257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:36.648733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-b542c08f-363f-45c6-b41d-05b931e856cc req-e87a827f-314c-4f36-a275-cb1d4434c893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241", "tag": "df4d7c5e-93cd-42b9-998b-7c78ab449dc1"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:36.677953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-b542c08f-363f-45c6-b41d-05b931e856cc req-e87a827f-314c-4f36-a275-cb1d4434c893 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:36.679801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-b542c08f-363f-45c6-b41d-05b931e856cc req-e87a827f-314c-4f36-a275-cb1d4434c893 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:36.681280 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-b542c08f-363f-45c6-b41d-05b931e856cc req-e87a827f-314c-4f36-a275-cb1d4434c893 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:36.697529 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-b542c08f-363f-45c6-b41d-05b931e856cc req-e87a827f-314c-4f36-a275-cb1d4434c893 service nova] Creating event network-changed:df4d7c5e-93cd-42b9-998b-7c78ab449dc1 for instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 on hv-cinder-85919 Sep 24 19:49:36.703924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-b542c08f-363f-45c6-b41d-05b931e856cc req-e87a827f-314c-4f36-a275-cb1d4434c893 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060585 Sep 24 19:49:36.705557 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 306/657] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:36.736436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lazy-loading 'services' on Instance uuid 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:49:36.827184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1eaad5be-1d88-43b8-bf55-9de7ef30fb60 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments/07085d30-a2e7-4023-895d-3abd72f2f2eb" status: 202 len: 0 microversion: 2.1 time: 0.237286 Sep 24 19:49:36.828387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 352/658] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:49:36 2022] DELETE /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments/07085d30-a2e7-4023-895d-3abd72f2f2eb => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:49:36.834908 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:36.837408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:36.838208 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:36.844197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:36.848507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:36.849209 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:36.849815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:36.851658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:36.852321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:36.852764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:36.853249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:36.853363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:36.854125 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:36.854956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:36.855542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:36.856008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:36.899446 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-51b2b2f8-bf7d-4f14-b724-7962c960ec2d tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065393 Sep 24 19:49:36.901475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 353/659] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:36 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:37.066466 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:37.078864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:37.082449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:37.083973 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-318f7289-0173-4a4f-9eb9-73c0d695a2bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1406 microversion: 2.20 time: 0.257452 Sep 24 19:49:37.086142 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 307/660] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:36 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:37.914750 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:37.917138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:37.926832 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:37.928151 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:37.930063 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:37.930860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:37.931393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:37.931910 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:37.964207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-84cfe247-3ab7-47ff-9816-6cfa3f8908ee tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054485 Sep 24 19:49:37.964895 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 354/661] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:37 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:38.111361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:38.112299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:38.115871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:38.119593 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:38.120160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:38.120668 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:38.121438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:38.122020 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:38.123637 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:38.263177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:38.271571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:38.273018 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:38.274185 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9adb1b48-a99a-40ef-ab48-6e8c73c9a38e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1406 microversion: 2.20 time: 0.167280 Sep 24 19:49:38.287462 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 308/662] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:38 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:38.724323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-560c1370-cf1e-4b6f-a313-fb6b87127789 req-bfd9fbd0-d7d1-4d57-a688-059b87aac9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c550fec-675d-43cd-9f53-9d9e3393ce01", "tag": "d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:38.733520 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-560c1370-cf1e-4b6f-a313-fb6b87127789 req-bfd9fbd0-d7d1-4d57-a688-059b87aac9e4 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:38.734004 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-560c1370-cf1e-4b6f-a313-fb6b87127789 req-bfd9fbd0-d7d1-4d57-a688-059b87aac9e4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:38.734434 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-560c1370-cf1e-4b6f-a313-fb6b87127789 req-bfd9fbd0-d7d1-4d57-a688-059b87aac9e4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:38.746680 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-560c1370-cf1e-4b6f-a313-fb6b87127789 req-bfd9fbd0-d7d1-4d57-a688-059b87aac9e4 service nova] Creating event network-changed:d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26 for instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 on hv-cinder-85919 Sep 24 19:49:38.751359 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-560c1370-cf1e-4b6f-a313-fb6b87127789 req-bfd9fbd0-d7d1-4d57-a688-059b87aac9e4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 Sep 24 19:49:38.751976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 355/663] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:38.979644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:38.981755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:38.987883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:38.988366 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:38.988800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:38.989483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:38.989940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:38.990363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:39.019818 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d7226750-2027-49ce-a34b-e543df8bb722 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044129 Sep 24 19:49:39.020364 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 309/664] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:38 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:49:39.031982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:39.032621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:39.038661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:39.039145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:39.039618 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:39.040306 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:39.040762 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:39.041191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:39.057119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:39.124836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] HTTP exception thrown: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 is not attached to volume 07085d30-a2e7-4023-895d-3abd72f2f2eb Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Request method failure captured: Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments/07085d30-a2e7-4023-895d-3abd72f2f2eb HTTP/1.1 Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL16WGbeHCDFKVp0lk4Z2xN2oLLHr-VpcUy7mL_WW-3P3EJjLP6XzQV9Vybi93a-CBsQvZZ7QFp2daiE_oiSVbXqEVnlJ-hx-3oFOaNZypwSbPId7DXyCmPuPAPoZGujolXN_mco_Zq6UJzQ_nXsDkJxPsnFsBAG4DY7_liub67zBkuY Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 8cb38d1aae344b868976df799b74b0f5 Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-TestMinimumBasicScenario-1248016305 Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:49:39.131714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-TestMinimumBasicScenario-1248016305 Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 8cb38d1aae344b868976df799b74b0f5 Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1248016305 Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-TestMinimumBasicScenario-1248016305-project Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 47773b38da48458fa356f34d259d3478 Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-TestMinimumBasicScenario-1248016305-project Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:49:39.133319 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 is not attached to volume 07085d30-a2e7-4023-895d-3abd72f2f2eb Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'server_id': '5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241', 'id': '07085d30-a2e7-4023-895d-3abd72f2f2eb'} Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 07085d30-a2e7-4023-895d-3abd72f2f2eb. Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:49:39.134173 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 is not attached to volume 07085d30-a2e7-4023-895d-3abd72f2f2eb Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 is not attached to volume 07085d30-a2e7-4023-895d-3abd72f2f2eb Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:49:39.135605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Returning 404 to user: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 is not attached to volume 07085d30-a2e7-4023-895d-3abd72f2f2eb {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:49:39.136682 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b59ffc13-ca7b-42d7-8b87-2cf8ccb4f806 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments/07085d30-a2e7-4023-895d-3abd72f2f2eb" status: 404 len: 154 microversion: 2.1 time: 0.106238 Sep 24 19:49:39.136682 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 356/665] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:49:39 2022] DELETE /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241/os-volume_attachments/07085d30-a2e7-4023-895d-3abd72f2f2eb => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:49:39.303088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:39.303728 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:39.311003 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:39.311493 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:39.311937 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:39.312635 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:39.313095 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:39.313523 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:39.443293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:39.451688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:39.453158 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:39.454266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-dc824aa3-d001-41a1-8e11-a10d04d77fc6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1406 microversion: 2.20 time: 0.155149 Sep 24 19:49:39.454868 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 310/666] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:39 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:40.275666 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:40.276218 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:40.282861 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:40.283363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:40.283831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:40.284542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:40.284999 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:40.285636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:40.315643 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:49:40.401839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0d74c034-3b90-43a9-a38e-42db5bf0cab5 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 204 len: 0 microversion: 2.1 time: 0.129905 Sep 24 19:49:40.406432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 357/667] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:49:40 2022] DELETE /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:49:40.412377 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:40.413699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:40.422562 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:40.423572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:40.424353 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:40.425262 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:40.425722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:40.426192 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:40.480008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:40.480713 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:40.486788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:40.487283 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:40.487749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:40.488457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:40.489183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:40.489308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:40.568799 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:40.576756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8b895146-8bd2-4123-8b78-6ba405781ad1 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1553 microversion: 2.1 time: 0.168319 Sep 24 19:49:40.577334 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 311/668] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:40 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:40.633627 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:40.642458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:40.643937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:40.645035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0ebc571a-d3b0-4be6-8c45-9ca6d6e70ae6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1406 microversion: 2.20 time: 0.169513 Sep 24 19:49:40.645585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 358/669] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:40 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:49:41.600884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:41.601602 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:41.608518 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:41.609042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:41.609467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:41.610176 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:41.610671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:41.611103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:41.673573 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:41.674164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:41.680669 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:41.681161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:41.681623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:41.682327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:41.682780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:41.683207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:41.747461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:41.756205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8a7e96d3-430c-473c-9a4f-72fbfcb8c775 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1553 microversion: 2.1 time: 0.159162 Sep 24 19:49:41.756794 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 312/670] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:41 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:41.813802 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:41.822233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:41.823711 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:41.824820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9a425ee9-5881-484b-9136-16e649671e82 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1406 microversion: 2.20 time: 0.155652 Sep 24 19:49:41.825366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 359/671] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:41 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:42.357729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-54e3e6a7-584a-48f9-a1d4-ba9831dc18d7 req-a628013a-e5f3-4f21-b161-09dc2d052ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c550fec-675d-43cd-9f53-9d9e3393ce01", "name": "network-vif-plugged", "status": "completed", "tag": "d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:42.368731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-54e3e6a7-584a-48f9-a1d4-ba9831dc18d7 req-a628013a-e5f3-4f21-b161-09dc2d052ab9 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:42.369246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-54e3e6a7-584a-48f9-a1d4-ba9831dc18d7 req-a628013a-e5f3-4f21-b161-09dc2d052ab9 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:42.369741 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-54e3e6a7-584a-48f9-a1d4-ba9831dc18d7 req-a628013a-e5f3-4f21-b161-09dc2d052ab9 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:42.383772 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-54e3e6a7-584a-48f9-a1d4-ba9831dc18d7 req-a628013a-e5f3-4f21-b161-09dc2d052ab9 service nova] Creating event network-vif-plugged:d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26 for instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 on hv-cinder-85919 Sep 24 19:49:42.388747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-54e3e6a7-584a-48f9-a1d4-ba9831dc18d7 req-a628013a-e5f3-4f21-b161-09dc2d052ab9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036312 Sep 24 19:49:42.389350 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 313/672] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:42.782826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:42.783711 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:42.791360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:42.791998 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:42.792495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:42.793400 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:42.793918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:42.794671 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:42.853056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:42.854534 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:42.861323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:42.861811 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:42.862243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:42.862944 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:42.863399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:42.864119 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:43.011335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:43.022307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:43.024517 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:43.026199 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-64a9be25-d201-441b-9134-0aeb9be915f5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1406 microversion: 2.20 time: 0.177795 Sep 24 19:49:43.027065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 314/673] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:42 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:49:43.090409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:43.098163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e321f150-edf4-4cd1-b992-55d99b76f997 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1553 microversion: 2.1 time: 0.321432 Sep 24 19:49:43.098913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 360/674] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:42 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:43.336979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-ad782b02-7167-4948-9f9e-b35d00a3e0f6 req-14207657-e847-4166-956c-f6ed258fdb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241", "name": "network-vif-deleted", "tag": "df4d7c5e-93cd-42b9-998b-7c78ab449dc1"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:43.347065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ad782b02-7167-4948-9f9e-b35d00a3e0f6 req-14207657-e847-4166-956c-f6ed258fdb55 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:43.347638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ad782b02-7167-4948-9f9e-b35d00a3e0f6 req-14207657-e847-4166-956c-f6ed258fdb55 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:43.348073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ad782b02-7167-4948-9f9e-b35d00a3e0f6 req-14207657-e847-4166-956c-f6ed258fdb55 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:43.358828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-ad782b02-7167-4948-9f9e-b35d00a3e0f6 req-14207657-e847-4166-956c-f6ed258fdb55 service nova] Creating event network-vif-deleted:df4d7c5e-93cd-42b9-998b-7c78ab449dc1 for instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 on hv-cinder-85919 Sep 24 19:49:43.364314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-ad782b02-7167-4948-9f9e-b35d00a3e0f6 req-14207657-e847-4166-956c-f6ed258fdb55 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031401 Sep 24 19:49:43.364922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 315/675] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:49:44.063410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:44.064097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:44.066272 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:44.066961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:44.073832 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:44.074336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:44.074777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:44.075530 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:44.076179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:44.076780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:44.129231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:44.129970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:44.132824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=6 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:44.138937 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:44.139456 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:44.139913 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:44.140842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:44.141310 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:44.141746 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:44.177335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:44.177834 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:44.178284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:44.178742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lazy-loading 'fault' on Instance uuid 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:49:44.350188 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:44.360455 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7b2fa1af-1db5-49de-ae7f-bc31ef81b7c8 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1348 microversion: 2.1 time: 0.238799 Sep 24 19:49:44.361256 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 316/676] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:44 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1348 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:44.415495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:44.424737 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:44.426218 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:44.427322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-81d3a3b2-3a0a-4b09-b8bb-67830e764669 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1406 microversion: 2.20 time: 0.370412 Sep 24 19:49:44.427905 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 361/677] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:44 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:49:45.384673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:45.385316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:45.392192 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:45.392681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:45.393126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:45.393841 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:45.394298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:45.394811 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:45.430577 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:45.431096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:45.431963 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:45.432065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lazy-loading 'fault' on Instance uuid 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:49:45.452425 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:45.453171 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:45.460032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:45.460527 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:45.460968 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:45.461673 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:45.462133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:45.462560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:45.477433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47773b38da48458fa356f34d259d3478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cb38d1aae344b868976df799b74b0f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:45.486648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-18d62031-fc16-4399-92fc-7277d3e36744 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 200 len: 1348 microversion: 2.1 time: 0.106539 Sep 24 19:49:45.487485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 317/678] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:45 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:45.604393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:45.612818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:45.614270 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:45.615442 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-64decde1-4376-446d-9b59-a07068542faf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1598 microversion: 2.20 time: 0.166970 Sep 24 19:49:45.615998 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 362/679] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:49:45 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:49:45.640237 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:45.641268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:45.647153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:45.647679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:45.648128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:45.648828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:45.649292 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:45.649722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:45.729637 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9a846357-b090-46d7-9de6-d19325851e2b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093325 Sep 24 19:49:45.730224 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 318/680] 10.222.0.55 () {60 vars in 1316 bytes} [Sat Sep 24 19:49:45 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:49:46.440178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:46.440699 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:46.446925 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:46.447408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:46.447871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:46.448570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:46.449026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:46.449451 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:46.474672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b1cfd508-8684-4d9f-b9c8-914737226e1e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/ips" status: 200 len: 150 microversion: 2.1 time: 0.038796 Sep 24 19:49:46.475395 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 363/681] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:49:46 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:46.510736 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:46.511352 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] [instance: 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:46.518563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:46.519273 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:46.519738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:46.520642 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:46.521108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:46.521536 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:46.536211 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] HTTP exception thrown: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 could not be found. Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Request method failure captured: Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 HTTP/1.1 Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL16WGbeHCDFKVp0lk4Z2xN2oLLHr-VpcUy7mL_WW-3P3EJjLP6XzQV9Vybi93a-CBsQvZZ7QFp2daiE_oiSVbXqEVnlJ-hx-3oFOaNZypwSbPId7DXyCmPuPAPoZGujolXN_mco_Zq6UJzQ_nXsDkJxPsnFsBAG4DY7_liub67zBkuY Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 8cb38d1aae344b868976df799b74b0f5 Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-TestMinimumBasicScenario-1248016305 Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:49:46.537939 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/8cb38d1aae344b868976df799b74b0f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-TestMinimumBasicScenario-1248016305 Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 8cb38d1aae344b868976df799b74b0f5 Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1248016305 Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-TestMinimumBasicScenario-1248016305-project Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 47773b38da48458fa356f34d259d3478 Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-TestMinimumBasicScenario-1248016305-project Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 could not be found. Sep 24 19:49:46.539311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241'} Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 could not be found. Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:49:46.540127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 could not be found. Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 could not be found. Sep 24 19:49:46.541433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:46.542579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Returning 404 to user: Instance 5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:49:46.542579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-363fd3d6-0076-4755-ab1b-181d86a2e1a0 tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241" status: 404 len: 111 microversion: 2.1 time: 0.033083 Sep 24 19:49:46.542579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 319/682] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:46 2022] GET /compute/v2.1/servers/5f5ab2fb-24e5-4dc6-8eaa-0dd7fcfb8241 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:49:46.548830 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-76639087-4f33-40de-8e41-4bd039a337df tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] Calling method '.version_select at 0x7f54179753a0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:46.570116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-76639087-4f33-40de-8e41-4bd039a337df tempest-TestMinimumBasicScenario-1248016305 tempest-TestMinimumBasicScenario-1248016305-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-391288128" status: 202 len: 0 microversion: 2.1 time: 0.025585 Sep 24 19:49:46.570830 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 364/683] 10.222.0.55 () {58 vars in 1269 bytes} [Sat Sep 24 19:49:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-391288128 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:49:47.003352 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-ddbe0de0-8e92-412f-b84e-cbec7c2dd114 req-d6995dd0-7591-4626-8b97-648f5189d97e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c550fec-675d-43cd-9f53-9d9e3393ce01", "tag": "d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:47.013056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ddbe0de0-8e92-412f-b84e-cbec7c2dd114 req-d6995dd0-7591-4626-8b97-648f5189d97e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:47.013424 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ddbe0de0-8e92-412f-b84e-cbec7c2dd114 req-d6995dd0-7591-4626-8b97-648f5189d97e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:47.014057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ddbe0de0-8e92-412f-b84e-cbec7c2dd114 req-d6995dd0-7591-4626-8b97-648f5189d97e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:47.030438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-ddbe0de0-8e92-412f-b84e-cbec7c2dd114 req-d6995dd0-7591-4626-8b97-648f5189d97e service nova] Creating event network-changed:d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26 for instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 on hv-cinder-85919 Sep 24 19:49:47.036716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-ddbe0de0-8e92-412f-b84e-cbec7c2dd114 req-d6995dd0-7591-4626-8b97-648f5189d97e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037128 Sep 24 19:49:47.037540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 320/684] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:49:47.918443 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:47.921374 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:47.929344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:47.929995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:47.930534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:47.931338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:47.931940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:47.932471 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:48.262888 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9987f9e8-9941-4a7f-8383-4a6faa32ba48 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348989 Sep 24 19:49:48.282131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 365/685] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:49:47 2022] POST /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:49:55.452445 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:55.453919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:55.462086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:55.462707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:55.463389 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:55.464443 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:55.465378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:55.466032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:55.570025 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lazy-loading 'services' on Instance uuid f81c1923-5243-4247-aee6-805f902927ca {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:49:55.651043 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a5e3e638-4d0d-439a-a8e3-26d55b87ae4c tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments/b7f744f5-dba7-43da-9bb6-6f92219cf0b9" status: 202 len: 0 microversion: 2.1 time: 0.205490 Sep 24 19:49:55.651736 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 321/686] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:49:55 2022] DELETE /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments/b7f744f5-dba7-43da-9bb6-6f92219cf0b9 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:49:55.662773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:55.672043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:55.674197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:55.682475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:55.682974 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:55.683674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:55.684393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:55.685037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:55.685470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:55.726438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c174a17b-8a4f-4477-87d3-93c269cd3e84 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069200 Sep 24 19:49:55.727021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 366/687] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:55 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:55.893477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:49:55.896123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:55.902581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:55.903093 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:55.903595 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:55.904329 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:55.904805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:55.905270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:56.008188 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Invalid volume: volume ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a is already attached to instances: ee50330a-a26e-440d-9b04-4eddbbb417f9 Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: POST /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments HTTP/1.1 Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 74 Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:49:56.009945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {"volumeAttachment": {"volumeId": "ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a"}} Sep 24 19:49:56.011504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Invalid volume: volume ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a is already attached to instances: ee50330a-a26e-440d-9b04-4eddbbb417f9 Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'server_id': 'ee50330a-a26e-440d-9b04-4eddbbb417f9', 'body': {'volumeAttachment': {'volumeId': 'ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a'}}} Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a is already attached to instances: ee50330a-a26e-440d-9b04-4eddbbb417f9 Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:56.012361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a is already attached to instances: ee50330a-a26e-440d-9b04-4eddbbb417f9 Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:49:56.013803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a is already attached to instances: ee50330a-a26e-440d-9b04-4eddbbb417f9 Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 400 to user: Invalid volume: volume ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a is already attached to instances: ee50330a-a26e-440d-9b04-4eddbbb417f9 {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8f2d287c-6fd9-47ee-b341-02e5eb361853 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123051 Sep 24 19:49:56.015275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 322/688] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:49:55 2022] POST /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:49:56.082149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:56.082671 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:56.089103 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:56.089583 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:56.090017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:56.090706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:56.091162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:56.091622 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:56.185634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lazy-loading 'services' on Instance uuid ee50330a-a26e-440d-9b04-4eddbbb417f9 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:49:56.258771 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3363f597-9db1-49d7-bef2-0df7b516301c tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments/ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a" status: 202 len: 0 microversion: 2.1 time: 0.181038 Sep 24 19:49:56.259277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 367/689] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:49:56 2022] DELETE /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments/ea7fbfbc-a4be-4e4b-88de-bdbbb0b5b56a => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:49:56.268607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:56.270928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:56.278015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:56.278510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:56.278982 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:56.279738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:56.280204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:56.280761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:56.307215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:56.314273 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-70c35890-c903-4d89-ae13-ca26c5fceec9 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050412 Sep 24 19:49:56.314846 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 323/690] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:56 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:56.740970 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:56.743465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:56.750461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:56.751458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:56.751917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:56.752798 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:56.753275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:56.753882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:56.786333 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-dc33fcde-fe6c-43cb-8c73-da3146e2ec63 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049810 Sep 24 19:49:56.786866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 368/691] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:56 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:57.328088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:57.330166 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:57.337461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:57.337960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:57.338406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:57.339176 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:57.339679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:57.340173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:57.376587 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c9a7c04a-ccba-46f5-8988-81ba13f7ec25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053432 Sep 24 19:49:57.377177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 324/692] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:57 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:49:57.799691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:57.801978 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:57.808698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:57.809200 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:57.809621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:57.810326 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:57.810800 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:57.811205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:57.850798 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c657f17c-c929-45dd-b493-ab97293bccdd tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055542 Sep 24 19:49:57.851362 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 369/693] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:57 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:49:57.933707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:57.934247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:57.942436 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:57.942958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:57.943451 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:57.944180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:57.944673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:57.945136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:57.970402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:49:58.047317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-92c89d85-b7d0-43dd-913c-272141d0d2bc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 204 len: 0 microversion: 2.1 time: 0.116827 Sep 24 19:49:58.048024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 325/694] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:49:57 2022] DELETE /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:49:58.057042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:58.057657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:58.064896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.065585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.066021 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.066719 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.067179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.067635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.201777 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:58.204827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:49:58.213415 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f922a8c8-4101-4af0-8306-efb501cf7adf tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1689 microversion: 2.1 time: 0.160896 Sep 24 19:49:58.213989 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 370/695] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:58 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:58.389416 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:58.391730 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:58.398472 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.398905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.399354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.400098 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.400567 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.401010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.432200 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-72742870-4a10-4451-9024-2ff5ee12d1d1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047415 Sep 24 19:49:58.432761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 326/696] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:49:58 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:49:58.499091 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:58.499807 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:58.507219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.507808 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.508316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.509064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.509571 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.510046 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.536063 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:49:58.615863 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-861c67dc-c648-4cb4-a9ca-29949a7a6f03 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 204 len: 0 microversion: 2.1 time: 0.120781 Sep 24 19:49:58.616805 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 371/697] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:49:58 2022] DELETE /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:49:58.627124 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:58.627767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:58.633864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.634361 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.634794 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.635526 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:58.635990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:58.636433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:58.774486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:58.784421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-78658e9e-2766-46ce-b351-a1a387e9b986 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1682 microversion: 2.1 time: 0.161371 Sep 24 19:49:58.785007 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 327/698] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:58 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:49:59.237611 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:59.238308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:59.244686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:59.245169 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:59.245602 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:59.246290 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:59.246747 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:59.247172 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:59.631237 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:49:59.639109 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-58460203-a000-4b96-bc88-83ed98c58d32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1689 microversion: 2.1 time: 0.406468 Sep 24 19:49:59.640242 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 372/699] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:59 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1689 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:49:59.975409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:49:59.976141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:49:59.982144 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:59.982630 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:59.983071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:49:59.983934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:49:59.984398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:49:59.984918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:00.117380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:00.125269 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-330265e3-a808-42e9-a1f7-2ef424be81de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1682 microversion: 2.1 time: 0.319486 Sep 24 19:50:00.125851 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 328/700] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:49:59 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1682 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:00.662869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:00.663540 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:00.670486 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:00.671056 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:00.672062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:00.672908 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:00.673380 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:00.673920 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:00.806704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:00.814787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9470241e-62b9-4173-a89c-dd3a0c252054 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1689 microversion: 2.1 time: 0.155897 Sep 24 19:50:00.815341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 373/701] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:00 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:01.152623 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:01.153436 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:01.163762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:01.164258 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:01.164707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:01.165409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:01.165869 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:01.166296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:01.317460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:01.325421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-da067972-6ba8-40e6-8ad0-fee16feb9915 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1682 microversion: 2.1 time: 0.179835 Sep 24 19:50:01.325993 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 329/702] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:01 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:01.840042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:01.840661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:01.847805 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:01.848302 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:01.848748 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:01.849460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:01.849927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:01.850362 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:01.979027 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:01.987508 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0511e4a8-7b4c-489a-bad0-e5e6d56d685e tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1689 microversion: 2.1 time: 0.152361 Sep 24 19:50:01.988174 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 374/703] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:01 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:02.350296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:02.350925 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:02.356947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:02.357431 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:02.357871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:02.359126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:02.359626 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:02.360057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:02.498153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:02.506446 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-068b5955-68d7-4f40-bab7-454570cac8b2 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1682 microversion: 2.1 time: 0.160137 Sep 24 19:50:02.507078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 330/704] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:02 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:03.012287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:03.013049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:03.021566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:03.022167 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:03.022627 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:03.023453 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:03.024043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:03.024592 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:03.185969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:03.194971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-21c82a58-0587-4ae5-a60b-2cf836f3ea2b tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1689 microversion: 2.1 time: 0.187457 Sep 24 19:50:03.195586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 375/705] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:03 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:03.530884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:03.531572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:03.538399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:03.538904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:03.539387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:03.540158 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:03.540669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:03.541165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:03.678314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:03.685992 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f96d49d1-cfe3-4f51-abcb-e6c2fe16f3cf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1682 microversion: 2.1 time: 0.159518 Sep 24 19:50:03.686605 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 331/706] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:03 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:04.218645 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:04.219330 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:04.225921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:04.226415 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:04.226867 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:04.227606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:04.228080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:04.228514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:04.495874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:04.504243 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7b1f78af-e029-4c80-94c5-ef71cb3db731 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1689 microversion: 2.1 time: 0.289874 Sep 24 19:50:04.504813 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 376/707] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:04 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1689 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:04.710538 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:04.714881 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:04.722732 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:04.723615 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:04.724129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:04.725097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:04.725655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:04.726744 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:04.813493 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:04.822673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1c59853c-484e-41e4-8452-75bbdb795392 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1614 microversion: 2.1 time: 0.116383 Sep 24 19:50:04.823266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 332/708] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:04 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:04.982320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-af7d18c7-831d-437e-8b5c-acd0bab5b650 req-db9d88a2-a3b7-45b0-a001-0e072552ee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee50330a-a26e-440d-9b04-4eddbbb417f9", "name": "network-vif-deleted", "tag": "f6946e56-e3ff-4aca-9ce2-47ef56094c82"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:05.000816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-af7d18c7-831d-437e-8b5c-acd0bab5b650 req-db9d88a2-a3b7-45b0-a001-0e072552ee48 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:05.001854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-af7d18c7-831d-437e-8b5c-acd0bab5b650 req-db9d88a2-a3b7-45b0-a001-0e072552ee48 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:05.002532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-af7d18c7-831d-437e-8b5c-acd0bab5b650 req-db9d88a2-a3b7-45b0-a001-0e072552ee48 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:05.024565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-af7d18c7-831d-437e-8b5c-acd0bab5b650 req-db9d88a2-a3b7-45b0-a001-0e072552ee48 service nova] Creating event network-vif-deleted:f6946e56-e3ff-4aca-9ce2-47ef56094c82 for instance ee50330a-a26e-440d-9b04-4eddbbb417f9 on hv-cinder-85919 Sep 24 19:50:05.033282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-af7d18c7-831d-437e-8b5c-acd0bab5b650 req-db9d88a2-a3b7-45b0-a001-0e072552ee48 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061578 Sep 24 19:50:05.034384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 377/709] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:05.529137 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:05.530113 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:05.537070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:05.537657 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:05.538180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:05.538965 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:05.539533 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:05.540041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:05.574692 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:05.575195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:05.575663 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:05.576116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lazy-loading 'fault' on Instance uuid f81c1923-5243-4247-aee6-805f902927ca {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:50:05.620947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:05.630045 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7abf5572-c0f5-4f0b-82d6-8c01234b1326 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 200 len: 1335 microversion: 2.1 time: 0.104862 Sep 24 19:50:05.630626 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 333/710] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:05 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:05.851478 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:05.853196 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:05.867503 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:05.868636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:05.869316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:05.870282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:05.871007 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:05.872995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:05.919924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:05.920417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:05.921433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:05.922008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lazy-loading 'fault' on Instance uuid ee50330a-a26e-440d-9b04-4eddbbb417f9 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:50:05.968282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:05.975664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-77a78f08-4a0e-4451-bf5d-b5e80047db63 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 200 len: 1331 microversion: 2.1 time: 0.128520 Sep 24 19:50:05.976566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 378/711] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:05 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:06.653048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:06.653819 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: f81c1923-5243-4247-aee6-805f902927ca] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:06.662335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.663014 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.663628 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:06.664362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.664832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.665263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:06.680256 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] HTTP exception thrown: Instance f81c1923-5243-4247-aee6-805f902927ca could not be found. Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Request method failure captured: Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca HTTP/1.1 Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL144Co_KYV-KP0xPXbouvg98k2x3g34lAIMyI70xmmjXTgvwWCHJd0_jdF8LSgviKk2jF6tlX0pyXrudOUvOaHHPsytvnECLiNmgk2Wdx9PSH6ZiD_rpfPYCHphy5NXskDwR5s0-Y2b8_i-d5i6VrWEU4EKOAfPNzv2JMLiDfba29Qc Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:50:06.681961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: f417a94fed274bfbb88d23677a4877a7 Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance f81c1923-5243-4247-aee6-805f902927ca could not be found. Sep 24 19:50:06.683336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': 'f81c1923-5243-4247-aee6-805f902927ca'} Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f81c1923-5243-4247-aee6-805f902927ca could not be found. Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:50:06.684370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f81c1923-5243-4247-aee6-805f902927ca could not be found. Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f81c1923-5243-4247-aee6-805f902927ca could not be found. Sep 24 19:50:06.685726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:06.687975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Returning 404 to user: Instance f81c1923-5243-4247-aee6-805f902927ca could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:50:06.687975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-57bf0fb4-28d9-4f27-94d3-a80c2c875dca tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca" status: 404 len: 111 microversion: 2.1 time: 0.034700 Sep 24 19:50:06.687975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 334/712] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:06 2022] GET /compute/v2.1/servers/f81c1923-5243-4247-aee6-805f902927ca => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:50:06.693154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-668c768b-155f-446d-b7b3-a02e8a010713 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '.version_select at 0x7f54179a9ca0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:06.715583 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-668c768b-155f-446d-b7b3-a02e8a010713 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-787643600" status: 202 len: 0 microversion: 2.1 time: 0.025281 Sep 24 19:50:06.715583 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 379/713] 10.222.0.55 () {58 vars in 1218 bytes} [Sat Sep 24 19:50:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-787643600 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:50:06.724255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:06.726515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:06.732500 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.732996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.733492 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:06.734534 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.735004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.735449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:06.768614 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-fd2e1c19-cb6f-435a-b319-12dcd697e818 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048221 Sep 24 19:50:06.769189 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 335/714] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:50:06 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:50:06.842967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:06.843511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:06.849633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.850210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.850724 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:06.851528 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.852789 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.853312 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:06.889093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:50:06.972274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2d848180-32e0-4a24-854f-89484939cf10 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 204 len: 0 microversion: 2.1 time: 0.133189 Sep 24 19:50:06.973523 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 380/715] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:50:06 2022] DELETE /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:50:06.981960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:06.982613 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:06.990367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.990873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.991321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:06.992079 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:06.992548 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:06.993689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:07.001937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:07.002976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:07.010032 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:07.010963 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:07.011494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:07.012218 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:07.012723 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:07.013191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:07.028465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 HTTP/1.1 Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:50:07.030230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:50:07.031790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': 'ee50330a-a26e-440d-9b04-4eddbbb417f9'} Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:50:07.032704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:50:07.034049 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:07.035201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:50:07.035201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1309c5be-c25a-437a-800a-fbf12028b7a7 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 404 len: 111 microversion: 2.1 time: 0.034775 Sep 24 19:50:07.035201 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 381/716] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:06 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:50:07.041417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8491ef4e-d3fd-44c5-a74e-025636b1ba8e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '.version_select at 0x7f54179a3040>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:07.067040 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8491ef4e-d3fd-44c5-a74e-025636b1ba8e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332244171" status: 202 len: 0 microversion: 2.1 time: 0.029197 Sep 24 19:50:07.070932 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 382/717] 10.222.0.55 () {58 vars in 1221 bytes} [Sat Sep 24 19:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332244171 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:50:07.072962 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-26a52400-4a1d-41a1-89f1-646b142d5b5f req-adebae53-18ad-460d-b102-e6b51c928b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f81c1923-5243-4247-aee6-805f902927ca", "name": "network-vif-deleted", "tag": "844ee860-c3c3-460e-87aa-ab602ef8bf67"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:07.083514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-26a52400-4a1d-41a1-89f1-646b142d5b5f req-adebae53-18ad-460d-b102-e6b51c928b5a service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:07.084007 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-26a52400-4a1d-41a1-89f1-646b142d5b5f req-adebae53-18ad-460d-b102-e6b51c928b5a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:07.084655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-26a52400-4a1d-41a1-89f1-646b142d5b5f req-adebae53-18ad-460d-b102-e6b51c928b5a service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:07.095974 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-26a52400-4a1d-41a1-89f1-646b142d5b5f req-adebae53-18ad-460d-b102-e6b51c928b5a service nova] Creating event network-vif-deleted:844ee860-c3c3-460e-87aa-ab602ef8bf67 for instance f81c1923-5243-4247-aee6-805f902927ca on hv-cinder-85919 Sep 24 19:50:07.100890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-26a52400-4a1d-41a1-89f1-646b142d5b5f req-adebae53-18ad-460d-b102-e6b51c928b5a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031640 Sep 24 19:50:07.101873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 383/718] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:07.166450 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:07.176838 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e7659d36-ef0e-4a84-9fd4-4c85fdee4b89 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1675 microversion: 2.1 time: 0.198766 Sep 24 19:50:07.177697 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 336/719] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:06 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:07.787039 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8c9c85d9-99a8-449a-8f76-05039296ce54 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: .version_select at 0x7f5417975160>, body: {"keypair": {"name": "tempest-keypair-1023720443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx4sFFaSEHeO03jFM55eqvFgUH4fXrDptvPDrit/0BDD04WsaEp3eMsB91/EFopEcLRSCFiFutPPdmwZmO2piTzZUlANCXnWn95yYUbXWprl75fvTz+K/NQ3nz6hu1J/w=="}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:07.803005 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-8c9c85d9-99a8-449a-8f76-05039296ce54 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:50:07.808243 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-8c9c85d9-99a8-449a-8f76-05039296ce54 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'key_pairs'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:50:07.832961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8c9c85d9-99a8-449a-8f76-05039296ce54 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050334 Sep 24 19:50:07.833569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 384/720] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:50:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:50:08.207297 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:08.207899 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:08.210344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:08.216102 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:08.216601 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:08.217047 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:08.217850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:08.218323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:08.218848 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:08.356143 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:08.370050 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cc44294e-40a9-4ed2-b5e9-be05cb8276d6 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1675 microversion: 2.1 time: 0.166338 Sep 24 19:50:08.370744 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 337/721] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:08 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:09.394940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:09.396567 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:09.404050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:09.405146 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:09.405759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:09.406739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:09.407237 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:09.407690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:09.440394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1150571315", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccacbae6-4eff-4b60-b850-003263f855e0"}], "security_groups": [{"name": "tempest-securitygroup--490520975"}], "key_name": "tempest-keypair-1023720443", "user_data": "}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:09.564260 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] validate_networks() for [('ccacbae6-4eff-4b60-b850-003263f855e0', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:50:09.633812 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:09.643350 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0b261012-ff9d-46ce-a179-8a229955556f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1675 microversion: 2.1 time: 0.252336 Sep 24 19:50:09.644179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 385/722] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:09 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:09.687948 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:09.688458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:09.694579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:09.695367 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:09.695928 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:09.696591 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:09.697061 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:09.697494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:09.724979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:50:09.831526 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d8051b05-dd27-4238-9897-6a5bb8b72583 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "DELETE /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 204 len: 0 microversion: 2.1 time: 0.147134 Sep 24 19:50:09.832341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 386/723] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:50:09 2022] DELETE /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:50:09.843041 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:09.843996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:09.850967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:09.851600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:09.852140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:09.852953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:09.853510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:09.854035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:09.860264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:10.103961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:10.113707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4471a799-1637-4120-824c-199eab042c80 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1506 microversion: 2.1 time: 0.276591 Sep 24 19:50:10.114440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 387/724] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:09 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:10.125693 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:50:10.126491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:50:10.127154 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:50:10.127813 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:50:10.129079 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:50:10.139462 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:10.140174 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:10.140650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:10.141421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:10.141912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:10.142340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:10.161161 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:50:10.165399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Getting quotas for user be2ad8e7eefe447ca1374d49696b1318 and project 808b55bc616349cfb31ee041ce69c976. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:50:10.177923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:50:10.180318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:50:10.232374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9a63f7f5-0650-4a29-abf8-24ccf9c2dbac tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.797101 Sep 24 19:50:10.234239 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 338/725] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:50:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 19:50:10.245762 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fa40cd64-f80c-4159-b6a1-90586d59bb28 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:10.246652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fa40cd64-f80c-4159-b6a1-90586d59bb28 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:10.325869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fa40cd64-f80c-4159-b6a1-90586d59bb28 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:10.336262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fa40cd64-f80c-4159-b6a1-90586d59bb28 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1242 microversion: 2.1 time: 0.094106 Sep 24 19:50:10.337369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 388/726] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:10 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:10.460944 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-729b9d4e-d92f-451f-96fe-d5d6da00ad4a req-1472621a-7f27-4e02-8fae-35117f1fbee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c0ca8da-4101-49bb-8747-b834c6555edd", "name": "network-vif-deleted", "tag": "f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:10.473774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-729b9d4e-d92f-451f-96fe-d5d6da00ad4a req-1472621a-7f27-4e02-8fae-35117f1fbee2 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:10.474509 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-729b9d4e-d92f-451f-96fe-d5d6da00ad4a req-1472621a-7f27-4e02-8fae-35117f1fbee2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:10.474963 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-729b9d4e-d92f-451f-96fe-d5d6da00ad4a req-1472621a-7f27-4e02-8fae-35117f1fbee2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:10.490100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-729b9d4e-d92f-451f-96fe-d5d6da00ad4a req-1472621a-7f27-4e02-8fae-35117f1fbee2 service nova] Creating event network-vif-deleted:f24fe5e9-d6e4-4325-b1f1-8a23cab3fcab for instance 9c0ca8da-4101-49bb-8747-b834c6555edd on hv-cinder-85919 Sep 24 19:50:10.496100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-729b9d4e-d92f-451f-96fe-d5d6da00ad4a req-1472621a-7f27-4e02-8fae-35117f1fbee2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040398 Sep 24 19:50:10.497223 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 339/727] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:10.668800 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:10.670078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:10.679077 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:10.679714 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:10.680244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:10.681142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:10.681872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:10.682514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:10.757914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:10.768710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3ffe5d78-fded-4042-b58e-1d73b02adf43 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1608 microversion: 2.1 time: 0.104872 Sep 24 19:50:10.772176 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 389/728] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:10 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:11.140347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:11.141186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:11.147707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:11.148215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:11.148665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:11.149387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:11.149860 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:11.150299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:11.166982 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:11.296624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:11.304668 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7012b43c-67e8-4b6d-a4cc-b4209c7b5412 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1506 microversion: 2.1 time: 0.168862 Sep 24 19:50:11.311009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 340/729] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:11 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:11.360610 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:11.361235 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:11.367236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:11.367821 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:11.368262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:11.368969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:11.369435 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:11.369862 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:11.431444 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:11.439582 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-58123457-1349-4ae2-b9d2-bf1b1dc2879f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1246 microversion: 2.1 time: 0.083035 Sep 24 19:50:11.440154 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 390/730] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:11 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:11.792940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:11.793516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:11.801060 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:11.801554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:11.801997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:11.802698 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:11.803162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:11.803628 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:11.865386 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:11.873097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a212ee77-0cad-4bb7-8280-1e992f50d60d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1608 microversion: 2.1 time: 0.084547 Sep 24 19:50:11.873659 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 341/731] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:11 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1608 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:12.328665 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:12.329285 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:12.335840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.336338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.336771 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.337473 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.337930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.338356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.463085 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:12.463902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:12.470831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.471318 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.471796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.472499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.472964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.473413 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.526119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:12.536654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:12.539870 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-081a164c-cfb1-4642-bef7-04eceb80da7f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1506 microversion: 2.1 time: 0.216392 Sep 24 19:50:12.540982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 391/732] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:12 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:12.545228 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-34dc4f4c-1169-4b8a-a2ac-ef4f8d17cc9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1238 microversion: 2.1 time: 0.086861 Sep 24 19:50:12.545916 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 342/733] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:12 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:12.896336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:12.897161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:12.903315 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.904014 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.904637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.906292 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.907212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.907844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.949085 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.949776 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.950219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.950676 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lazy-loading 'fault' on Instance uuid 9c0ca8da-4101-49bb-8747-b834c6555edd {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:50:12.953291 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-56a69a4f-1df1-4d13-9a83-83d6de39bb01 req-89e55558-938c-4008-bbde-573a20448379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b340b141-ffdd-4b0e-99f4-fd4820056f61", "name": "network-vif-deleted", "tag": "e402482a-cd5d-428e-92e9-1fcf957e3f02"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:12.963313 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-56a69a4f-1df1-4d13-9a83-83d6de39bb01 req-89e55558-938c-4008-bbde-573a20448379 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:12.963916 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-56a69a4f-1df1-4d13-9a83-83d6de39bb01 req-89e55558-938c-4008-bbde-573a20448379 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:12.964426 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-56a69a4f-1df1-4d13-9a83-83d6de39bb01 req-89e55558-938c-4008-bbde-573a20448379 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:12.977513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-56a69a4f-1df1-4d13-9a83-83d6de39bb01 req-89e55558-938c-4008-bbde-573a20448379 service nova] Creating event network-vif-deleted:e402482a-cd5d-428e-92e9-1fcf957e3f02 for instance b340b141-ffdd-4b0e-99f4-fd4820056f61 on hv-cinder-85919 Sep 24 19:50:12.983134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-56a69a4f-1df1-4d13-9a83-83d6de39bb01 req-89e55558-938c-4008-bbde-573a20448379 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034177 Sep 24 19:50:12.984728 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 343/734] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:50:13.021192 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:13.029534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3e5cdef8-99bf-4eb6-b5c4-b9e071567f6a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 200 len: 1328 microversion: 2.1 time: 0.137100 Sep 24 19:50:13.031746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 392/735] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:12 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 1328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:13.565306 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:13.566510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:13.570329 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:13.570953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:13.576332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:13.577149 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:13.577263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:13.577706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:13.578031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:13.578148 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:13.578825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:13.579186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:13.579689 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:13.579789 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:13.580031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:13.580812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:13.623408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:13.624022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:13.624565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:13.628093 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lazy-loading 'fault' on Instance uuid b340b141-ffdd-4b0e-99f4-fd4820056f61 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:50:13.651142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:13.663118 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ca367409-696a-4aa6-97e6-3fbe822286d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1294 microversion: 2.1 time: 0.096716 Sep 24 19:50:13.663694 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 393/736] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:13 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:13.678186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:13.689584 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-70cec025-39c0-446f-87b2-2919a7afae91 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 200 len: 1311 microversion: 2.1 time: 0.129820 Sep 24 19:50:13.690565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 344/737] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:13 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:14.054378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:14.055107 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:14.061958 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.062952 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.063399 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.064135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.064597 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.065027 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.082635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] HTTP exception thrown: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Request method failure captured: Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd HTTP/1.1 Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL148O1nVi5Nkg3Sz_Gk5i6C7E0I7-8AlPmjxAzirtElASsxdrl65tC0waW0XQfSAfzOMMcPsUjf_5uedqmBzPWQEnsuS4JDCatYozIlEOV3REevG91xt0cPYzcXtSEYZpL8EqPyR9lJcysmRw-KfaPqhq3i9v_jlVi8JWn9Sq30xAJ8 Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:50:14.084678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_977038321e5a41e8ab137fede4d118d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 444719e34bf2457b9a58e182ef7fbd79 Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:50:14.086245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '9c0ca8da-4101-49bb-8747-b834c6555edd'} Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:50:14.087141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:50:14.088684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.089831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Returning 404 to user: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:50:14.089831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2d06587d-bf05-4ad6-ad42-05950ef40451 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 404 len: 111 microversion: 2.1 time: 0.035778 Sep 24 19:50:14.089831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 394/738] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:14 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:50:14.095103 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3fa5d410-e405-4b85-baf4-8fdc21888981 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '.version_select at 0x7f5417b615e0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:14.113656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3fa5d410-e405-4b85-baf4-8fdc21888981 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153442249" status: 202 len: 0 microversion: 2.1 time: 0.022386 Sep 24 19:50:14.114229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 345/739] 10.222.0.55 () {58 vars in 1221 bytes} [Sat Sep 24 19:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1153442249 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:50:14.691501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:14.693086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:14.701968 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.703174 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.704220 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.706110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.707165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.708185 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.718319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:14.719335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: b340b141-ffdd-4b0e-99f4-fd4820056f61] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:14.727029 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.728007 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.728705 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.729615 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.730247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.730907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.754056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] HTTP exception thrown: Instance b340b141-ffdd-4b0e-99f4-fd4820056f61 could not be found. Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Request method failure captured: Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 HTTP/1.1 Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL144Co_KYV-KP0xPXbouvg98k2x3g34lAIMyI70xmmjXTgvwWCHJd0_jdF8LSgviKk2jF6tlX0pyXrudOUvOaHHPsytvnECLiNmgk2Wdx9PSH6ZiD_rpfPYCHphy5NXskDwR5s0-Y2b8_i-d5i6VrWEU4EKOAfPNzv2JMLiDfba29Qc Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:50:14.756251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: f417a94fed274bfbb88d23677a4877a7 Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance b340b141-ffdd-4b0e-99f4-fd4820056f61 could not be found. Sep 24 19:50:14.757888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': 'b340b141-ffdd-4b0e-99f4-fd4820056f61'} Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b340b141-ffdd-4b0e-99f4-fd4820056f61 could not be found. Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:50:14.758900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b340b141-ffdd-4b0e-99f4-fd4820056f61 could not be found. Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b340b141-ffdd-4b0e-99f4-fd4820056f61 could not be found. Sep 24 19:50:14.760467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:50:14.763068 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Returning 404 to user: Instance b340b141-ffdd-4b0e-99f4-fd4820056f61 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:50:14.764203 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0cbaa725-5459-43ea-932b-c215fdcba56f tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61" status: 404 len: 111 microversion: 2.1 time: 0.051699 Sep 24 19:50:14.768542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 346/740] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:14 2022] GET /compute/v2.1/servers/b340b141-ffdd-4b0e-99f4-fd4820056f61 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:50:14.774141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:14.774966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:14.782167 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.783414 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.784120 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.785072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:14.785735 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:14.786358 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:14.819654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:50:14.959571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8c18f109-a11c-44e2-8b77-ef407284c1bb tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "DELETE /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 204 len: 0 microversion: 2.1 time: 0.189065 Sep 24 19:50:14.963867 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 347/741] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:50:14 2022] DELETE /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:50:14.972091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d0b9e5ed-55f0-4b86-a9ac-762717e34c5d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'create', calling method: .version_select at 0x7f5417b61e50>, body: {"keypair": {"name": "tempest-keypair-1478990488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqGmGi8yhXiWAABCoKCc8qXvl8fivfWDPujdXBZ1Zlrhv8b0QG5Hc48syXOxx6GrOD8OjzwzFbhaLgN1TkbOV7Jxr2jkbXY0UJfDW3BWtLTkSyfSz4OqJJe+2gEQQ6kNQ=="}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:14.994116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-d0b9e5ed-55f0-4b86-a9ac-762717e34c5d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for project 977038321e5a41e8ab137fede4d118d7. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:50:14.998926 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-d0b9e5ed-55f0-4b86-a9ac-762717e34c5d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for user 444719e34bf2457b9a58e182ef7fbd79 and project 977038321e5a41e8ab137fede4d118d7. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:50:15.030106 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d0b9e5ed-55f0-4b86-a9ac-762717e34c5d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064619 Sep 24 19:50:15.031268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 348/742] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:50:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:15.036833 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:15.037904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:15.045880 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:15.046475 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:15.047270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:15.048203 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:15.048733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:15.049386 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:15.103863 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:15.110393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-332c3a8a-d97b-49b4-bcfc-75613a062790 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.425508 Sep 24 19:50:15.111461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 395/743] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:14 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:15.242291 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:15.251778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a4dc71f6-eb93-4e25-af75-1b2b161eeddc tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.218871 Sep 24 19:50:15.252464 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 349/744] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:15 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:16.134432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:16.135066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:16.143449 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:16.143951 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:16.144408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:16.145121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:16.145584 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:16.146011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:16.276913 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:16.278061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:16.293252 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:16.295563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:16.298026 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:16.302515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c1a9b0a4-ec7d-41d1-afe9-66fb5938a0b5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.172006 Sep 24 19:50:16.303304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:16.303510 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 396/745] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:16 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:16.304915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:16.305580 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:16.306333 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:16.531812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:16.540084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cb25f70f-3763-4f65-9496-2fc3048eee32 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.268178 Sep 24 19:50:16.540668 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 350/746] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:16 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:16.723580 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-55947090", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "97ec7c2f-0754-40e4-8a0a-385cf50d53a8"}], "security_groups": [{"name": "tempest-securitygroup--1721772018"}], "key_name": "tempest-keypair-1478990488", "user_data": "}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:16.732717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:16.838062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] validate_networks() for [('97ec7c2f-0754-40e4-8a0a-385cf50d53a8', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:50:17.287901 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:50:17.288408 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:50:17.288793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:50:17.289203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:50:17.289618 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:50:17.299614 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:17.300112 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:17.300547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:17.301280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:17.301741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:17.302163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:17.320311 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for project 977038321e5a41e8ab137fede4d118d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:50:17.324949 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Getting quotas for user 444719e34bf2457b9a58e182ef7fbd79 and project 977038321e5a41e8ab137fede4d118d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:50:17.336410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:17.336947 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:50:17.337050 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:17.339145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:50:17.344221 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:17.344656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:17.345166 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:17.345875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:17.346334 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:17.346761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:17.394770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-741fd562-1236-4411-8a05-b7ae98b516c9 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.675931 Sep 24 19:50:17.395804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 397/747] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:50:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:50:17.407376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2b60627a-498f-425a-bc53-26691939d809 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:17.408213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2b60627a-498f-425a-bc53-26691939d809 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:17.466756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2b60627a-498f-425a-bc53-26691939d809 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:17.475048 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2b60627a-498f-425a-bc53-26691939d809 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1236 microversion: 2.1 time: 0.072169 Sep 24 19:50:17.475825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 398/748] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:17 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:17.502004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:17.509544 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d60aa835-79c9-4833-8769-76f9493cb169 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.177047 Sep 24 19:50:17.510114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 351/749] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:17 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:17.564149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:17.564770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:17.570729 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:17.571218 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:17.571773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:17.573739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:17.574205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:17.574634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:17.713299 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:17.721257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3dd8853d-8d03-49d6-9d93-ee0a2ef509d2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.161643 Sep 24 19:50:17.721828 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 399/750] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:17 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:18.497790 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:18.498508 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:18.505259 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:18.505843 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:18.506345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:18.507144 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:18.507703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:18.508337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:18.535460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:18.536742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:18.543976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:18.544984 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:18.545927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:18.546971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:18.547748 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:18.548388 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:18.593994 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:18.603019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0378c401-2535-4d8e-a061-aa18decf49f0 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1288 microversion: 2.1 time: 0.108983 Sep 24 19:50:18.603980 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 352/751] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:18 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1288 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:18.744449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:18.745244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:18.752101 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:18.752594 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:18.753035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:18.753752 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:18.754212 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:18.754643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:18.912862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:18.913202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:18.922231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3579a899-573e-43aa-b6a9-7c685f18def3 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1522 microversion: 2.1 time: 0.181464 Sep 24 19:50:18.922814 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 353/752] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:18 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:18.938764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8727bb4c-1e5c-4c90-a9d4-a7a316a963bc tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.399340 Sep 24 19:50:18.938764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 400/753] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:18 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:19.513973 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-9d3ccf36-55a9-4273-a834-d7e5d30b5744 req-a463f9aa-d991-4d6e-b17b-99059d3887d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9ca45e-085c-4ccf-a6b5-36960297291b", "tag": "5d8bf27f-a758-4118-ae21-8e85de0af835"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:19.524708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-9d3ccf36-55a9-4273-a834-d7e5d30b5744 req-a463f9aa-d991-4d6e-b17b-99059d3887d0 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:19.525219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-9d3ccf36-55a9-4273-a834-d7e5d30b5744 req-a463f9aa-d991-4d6e-b17b-99059d3887d0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:19.525663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-9d3ccf36-55a9-4273-a834-d7e5d30b5744 req-a463f9aa-d991-4d6e-b17b-99059d3887d0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:19.537186 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-9d3ccf36-55a9-4273-a834-d7e5d30b5744 req-a463f9aa-d991-4d6e-b17b-99059d3887d0 service nova] Creating event network-changed:5d8bf27f-a758-4118-ae21-8e85de0af835 for instance 9b9ca45e-085c-4ccf-a6b5-36960297291b on hv-cinder-85919 Sep 24 19:50:19.543133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-9d3ccf36-55a9-4273-a834-d7e5d30b5744 req-a463f9aa-d991-4d6e-b17b-99059d3887d0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032948 Sep 24 19:50:19.543725 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 401/754] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:50:19.626944 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:19.627605 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:19.641773 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:19.642336 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:19.643109 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:19.643922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:19.644553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:19.645210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:19.730214 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:19.740847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e48e3517-1836-4315-87eb-6fb04bc3041e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1294 microversion: 2.1 time: 0.118453 Sep 24 19:50:19.742037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 354/755] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:19 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:19.952064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:19.953658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:19.956904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:19.964258 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:19.964860 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:19.965382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:19.965671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:19.966589 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:19.967152 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:19.967842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:19.975255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:19.976088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:19.976698 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:19.977656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:19.978294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:19.978725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:20.010129 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:20.011017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:20.011971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:20.012702 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lazy-loading 'fault' on Instance uuid afc80c86-d224-4d77-9985-9658a8c0a47b {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:50:20.095302 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f417a94fed274bfbb88d23677a4877a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d671773b58240b1988f7c56ec6753b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:20.109163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0b8c2fac-ebb9-4ef6-b8fd-7f5deef28ef2 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 200 len: 1312 microversion: 2.1 time: 0.166290 Sep 24 19:50:20.110563 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 402/756] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:19 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:20.152070 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:20.276496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:20.285216 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ce097dfc-d956-4757-abcc-2b7ed939c0da tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.336808 Sep 24 19:50:20.285798 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 355/757] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:19 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:20.765833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:20.766667 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:20.772994 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:20.773627 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:20.774139 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:20.774880 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:20.775886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:20.775886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:20.921886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:20.929824 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-09ce22f6-8951-4a1d-9e3c-f0707a0b4554 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1362 microversion: 2.1 time: 0.168453 Sep 24 19:50:20.930337 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 403/758] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:20 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:21.133589 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:21.134223 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:21.134363 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:21.135013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] [instance: afc80c86-d224-4d77-9985-9658a8c0a47b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:21.142417 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.142998 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.143149 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.143621 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.143746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.144230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.144553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.145068 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.145166 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.145644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.145755 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.146209 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.161717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] HTTP exception thrown: Instance afc80c86-d224-4d77-9985-9658a8c0a47b could not be found. Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Request method failure captured: Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b HTTP/1.1 Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL144Co_KYV-KP0xPXbouvg98k2x3g34lAIMyI70xmmjXTgvwWCHJd0_jdF8LSgviKk2jF6tlX0pyXrudOUvOaHHPsytvnECLiNmgk2Wdx9PSH6ZiD_rpfPYCHphy5NXskDwR5s0-Y2b8_i-d5i6VrWEU4EKOAfPNzv2JMLiDfba29Qc Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:50:21.162956 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0d671773b58240b1988f7c56ec6753b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 0d671773b58240b1988f7c56ec6753b5 Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1058413832 Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: f417a94fed274bfbb88d23677a4877a7 Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1058413832-project Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance afc80c86-d224-4d77-9985-9658a8c0a47b could not be found. Sep 24 19:50:21.164535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': 'afc80c86-d224-4d77-9985-9658a8c0a47b'} Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc80c86-d224-4d77-9985-9658a8c0a47b could not be found. Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:50:21.165401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc80c86-d224-4d77-9985-9658a8c0a47b could not be found. Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc80c86-d224-4d77-9985-9658a8c0a47b could not be found. Sep 24 19:50:21.166911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:50:21.169078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] Returning 404 to user: Instance afc80c86-d224-4d77-9985-9658a8c0a47b could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:50:21.169078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-98cc133c-4aaa-4c3d-9a38-82ef8432f738 tempest-ServerRescueNegativeTestJSON-1058413832 tempest-ServerRescueNegativeTestJSON-1058413832-project] 10.222.0.55 "GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b" status: 404 len: 111 microversion: 2.1 time: 0.036527 Sep 24 19:50:21.169078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 404/759] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:21 2022] GET /compute/v2.1/servers/afc80c86-d224-4d77-9985-9658a8c0a47b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:50:21.178835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lazy-loading 'flavor' on Instance uuid 4ef25795-8222-4f8a-9427-86abea7da3d8 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:50:21.249170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:21.250550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-4b9ecc59-6f98-4669-b214-cb739a0f2c5b req-db6ccfe1-581b-4455-ab8c-f52e40347faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0", "tag": "31356b09-48e8-4e8f-8d96-f589c823cfae"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:21.273475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-4b9ecc59-6f98-4669-b214-cb739a0f2c5b req-db6ccfe1-581b-4455-ab8c-f52e40347faa service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.274128 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-4b9ecc59-6f98-4669-b214-cb739a0f2c5b req-db6ccfe1-581b-4455-ab8c-f52e40347faa service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.276470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-4b9ecc59-6f98-4669-b214-cb739a0f2c5b req-db6ccfe1-581b-4455-ab8c-f52e40347faa service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.276614 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-76902943-4314-4d1c-8aa8-d7c77bc42c24 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "POST /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8/action" status: 202 len: 0 microversion: 2.1 time: 0.146562 Sep 24 19:50:21.280642 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 356/760] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:50:21 2022] POST /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:50:21.289441 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:21.290511 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:21.298690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-4b9ecc59-6f98-4669-b214-cb739a0f2c5b req-db6ccfe1-581b-4455-ab8c-f52e40347faa service nova] Creating event network-changed:31356b09-48e8-4e8f-8d96-f589c823cfae for instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 on hv-cinder-85919 Sep 24 19:50:21.298901 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.299266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.299743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.300460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.300923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.301413 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.306322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-4b9ecc59-6f98-4669-b214-cb739a0f2c5b req-db6ccfe1-581b-4455-ab8c-f52e40347faa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066734 Sep 24 19:50:21.307334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 405/761] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:21.315307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:21.316353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:21.323334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.323877 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.324320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.325029 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.325499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.325930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.475232 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:21.483563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9f288882-e22e-4c7c-8213-b8e2f4e553a8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.199870 Sep 24 19:50:21.484217 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 357/762] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:21 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:21.577651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:21.586866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-04fbbda2-b036-4454-b681-03a1562c11d5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.276464 Sep 24 19:50:21.587926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 406/763] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:21 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:21.638043 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-19e2a485-e492-46d0-bfdb-56130e0393d9 req-189d9356-49e5-45ba-af8e-3dc559028d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc80c86-d224-4d77-9985-9658a8c0a47b", "name": "network-vif-deleted", "tag": "c1ba06bb-5a83-4d65-b2c1-1ee23f4fb7dd"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:21.648438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-19e2a485-e492-46d0-bfdb-56130e0393d9 req-189d9356-49e5-45ba-af8e-3dc559028d52 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.649135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-19e2a485-e492-46d0-bfdb-56130e0393d9 req-189d9356-49e5-45ba-af8e-3dc559028d52 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.649367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-19e2a485-e492-46d0-bfdb-56130e0393d9 req-189d9356-49e5-45ba-af8e-3dc559028d52 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.663010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-19e2a485-e492-46d0-bfdb-56130e0393d9 req-189d9356-49e5-45ba-af8e-3dc559028d52 service nova] Creating event network-vif-deleted:c1ba06bb-5a83-4d65-b2c1-1ee23f4fb7dd for instance afc80c86-d224-4d77-9985-9658a8c0a47b on hv-cinder-85919 Sep 24 19:50:21.667706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-19e2a485-e492-46d0-bfdb-56130e0393d9 req-189d9356-49e5-45ba-af8e-3dc559028d52 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099080 Sep 24 19:50:21.668501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 358/764] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:50:21.954571 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:21.961845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:21.961845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.962072 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.962534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:21.963213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:21.963761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:21.964640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:22.175999 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:22.184231 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7929cff7-5353-4142-9445-daba2ab05999 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1362 microversion: 2.1 time: 0.234250 Sep 24 19:50:22.184804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 407/765] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:21 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:22.509459 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:22.510342 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:22.518233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:22.522606 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:22.523078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:22.523871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:22.524347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:22.524786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:22.612305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:22.612985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:22.631883 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:22.638458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:22.639274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:22.641116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:22.641773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:22.642366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:22.667379 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:22.760851 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:22.769068 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4831c3d1-a6f1-4f78-b3fd-9e3e386d24dd tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.264954 Sep 24 19:50:22.769654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 359/766] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:22 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:22.923952 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:22.933042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-de4ac685-47e9-4837-8a91-fa80a1dfe242 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.325763 Sep 24 19:50:22.933637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 408/767] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:22 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:23.209387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:23.210266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:23.216549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:23.217049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:23.217635 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:23.218865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:23.219534 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:23.219966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:23.369125 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:23.378348 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f326e14a-08eb-4e60-8199-b56abcbf848a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1362 microversion: 2.1 time: 0.172663 Sep 24 19:50:23.379303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 360/768] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:23 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:23.793542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:23.794387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:23.801062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:23.801555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:23.801994 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:23.802700 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:23.803346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:23.803804 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:23.958363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:23.958915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:23.965501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:23.965995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:23.966435 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:23.967142 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:23.967639 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:23.968073 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:24.029979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:24.039887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-17773268-811d-4ee9-a660-d2f91a093c05 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.250448 Sep 24 19:50:24.047871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 409/769] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:23 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:24.129061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:24.137030 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-715eb655-4a94-4f3a-abb7-24af765dae1b tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.182636 Sep 24 19:50:24.137621 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 361/770] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:23 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:24.402225 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:24.402843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:24.409756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:24.410547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:24.411153 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:24.412087 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:24.412837 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:24.413431 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:24.622193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:24.630542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a4dba6f3-82d1-4e62-938c-628d474279bb tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1362 microversion: 2.1 time: 0.232278 Sep 24 19:50:24.632460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 410/771] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:24 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:24.873247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-8b169d2d-06c1-4308-89da-e059662454cc req-134e584a-ea57-4066-b2f2-314b806c2a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9ca45e-085c-4ccf-a6b5-36960297291b", "name": "network-vif-plugged", "status": "completed", "tag": "5d8bf27f-a758-4118-ae21-8e85de0af835"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:24.889354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-8b169d2d-06c1-4308-89da-e059662454cc req-134e584a-ea57-4066-b2f2-314b806c2a27 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:24.890076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-8b169d2d-06c1-4308-89da-e059662454cc req-134e584a-ea57-4066-b2f2-314b806c2a27 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:24.891330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-8b169d2d-06c1-4308-89da-e059662454cc req-134e584a-ea57-4066-b2f2-314b806c2a27 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:24.914505 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-8b169d2d-06c1-4308-89da-e059662454cc req-134e584a-ea57-4066-b2f2-314b806c2a27 service nova] Creating event network-vif-plugged:5d8bf27f-a758-4118-ae21-8e85de0af835 for instance 9b9ca45e-085c-4ccf-a6b5-36960297291b on hv-cinder-85919 Sep 24 19:50:24.922257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-8b169d2d-06c1-4308-89da-e059662454cc req-134e584a-ea57-4066-b2f2-314b806c2a27 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051888 Sep 24 19:50:24.923466 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 362/772] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:25.075958 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:25.085598 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:25.093138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:25.095301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:25.096133 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:25.098284 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:25.099199 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:25.100386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:25.161237 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:25.161958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:25.172799 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=10 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:25.174800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:25.175280 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:25.175761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:25.176738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:25.177372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:25.177976 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:25.272758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:25.282733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-55eaf2a5-b081-4c1d-8eee-8677748884d4 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.216032 Sep 24 19:50:25.283710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 411/773] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:25 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:25.385703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:25.394175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c61c34c8-bbc0-4b87-a492-6135cae77786 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.237862 Sep 24 19:50:25.395063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 363/774] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:25 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:25.655085 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:25.656718 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:25.662731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:25.663311 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:25.663788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:25.664499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:25.664967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:25.665598 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:25.820401 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:25.829356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-164f413c-e34f-4e1b-8701-d17f8f5c641d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1362 microversion: 2.1 time: 0.178570 Sep 24 19:50:25.830180 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 412/775] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:25 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:26.306915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:26.307528 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:26.314813 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:26.315309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:26.315796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:26.316505 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:26.316969 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:26.317398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:26.418975 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:26.422555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:26.430972 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:26.432179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:26.432848 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:26.434198 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:26.434921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:26.436305 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:26.494663 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:26.505527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8d140541-7635-427e-92b5-b80e48fef279 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.202695 Sep 24 19:50:26.506473 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 364/776] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:26 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:26.640936 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:26.668110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8f1eaceb-a742-4f9b-a46b-60667655807f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1367 microversion: 2.1 time: 0.237785 Sep 24 19:50:26.668868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 413/777] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:26 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:26.861072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:26.861729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:26.868657 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:26.869201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:26.869764 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:26.870872 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:26.871344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:26.872126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:26.943539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-f47db9dd-5850-4771-874e-743973fd8c38 req-7ba0d160-d918-4ebe-a24f-56cbbd5d74a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0", "name": "network-vif-plugged", "status": "completed", "tag": "31356b09-48e8-4e8f-8d96-f589c823cfae"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:26.954370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-f47db9dd-5850-4771-874e-743973fd8c38 req-7ba0d160-d918-4ebe-a24f-56cbbd5d74a1 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:26.954868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-f47db9dd-5850-4771-874e-743973fd8c38 req-7ba0d160-d918-4ebe-a24f-56cbbd5d74a1 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:26.955308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-f47db9dd-5850-4771-874e-743973fd8c38 req-7ba0d160-d918-4ebe-a24f-56cbbd5d74a1 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:26.966871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-f47db9dd-5850-4771-874e-743973fd8c38 req-7ba0d160-d918-4ebe-a24f-56cbbd5d74a1 service nova] Creating event network-vif-plugged:31356b09-48e8-4e8f-8d96-f589c823cfae for instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 on hv-cinder-85919 Sep 24 19:50:26.972886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-f47db9dd-5850-4771-874e-743973fd8c38 req-7ba0d160-d918-4ebe-a24f-56cbbd5d74a1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Sep 24 19:50:26.973738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 414/778] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:27.034832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:27.049618 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b6be0a5a-5525-43ee-8396-5c19be0b1ec2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1362 microversion: 2.1 time: 0.193350 Sep 24 19:50:27.050540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 365/779] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:26 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:27.526039 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:27.527166 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=14 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:27.532306 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:27.533019 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:27.540330 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:27.540783 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:27.541515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:27.542269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:27.542732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:27.543159 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:27.685447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:27.693697 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:27.695604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:27.695965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a276f745-1371-4e3c-bbea-1ad60f7ed3b2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.170672 Sep 24 19:50:27.702553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:27.703800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:27.704218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:27.705356 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:27.705938 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:27.706467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:27.710535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 415/780] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:27 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:27.882407 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:27.891850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-687437a3-2052-4079-a216-a57d747dabd0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1557 microversion: 2.1 time: 0.203056 Sep 24 19:50:27.892530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 366/781] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:27 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1557 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:50:27.915237 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:27.915786 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:27.922906 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:27.923406 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:27.924143 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:27.925165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:27.925635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:27.926070 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:28.005286 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6cc7fb40-16f9-4e9e-9140-2a07be7af23e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094293 Sep 24 19:50:28.006064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 416/782] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:50:27 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:28.078472 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:28.079617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:28.085767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:28.086275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:28.086703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:28.087408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:28.090973 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:28.091660 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:28.244171 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:28.252569 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e3611505-1813-45f3-86a5-7e50a330f197 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1362 microversion: 2.1 time: 0.178396 Sep 24 19:50:28.253476 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 367/783] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:28 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:28.723837 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:28.727155 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:28.733524 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:28.734145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:28.734753 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:28.735521 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:28.735999 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:28.736435 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:28.974595 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:28.982825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f5c68a79-eb83-4fa0-a745-8a28782f9e04 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.264664 Sep 24 19:50:28.983615 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 417/784] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:28 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:29.201942 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-855afc13-13f2-4325-b838-1a0b0d9e2cfb req-68abb6b1-5c6f-4b20-8297-69323e7bbbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b9ca45e-085c-4ccf-a6b5-36960297291b", "tag": "5d8bf27f-a758-4118-ae21-8e85de0af835"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:29.213720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-855afc13-13f2-4325-b838-1a0b0d9e2cfb req-68abb6b1-5c6f-4b20-8297-69323e7bbbf1 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:29.214514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-855afc13-13f2-4325-b838-1a0b0d9e2cfb req-68abb6b1-5c6f-4b20-8297-69323e7bbbf1 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:29.215135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-855afc13-13f2-4325-b838-1a0b0d9e2cfb req-68abb6b1-5c6f-4b20-8297-69323e7bbbf1 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:29.227876 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-855afc13-13f2-4325-b838-1a0b0d9e2cfb req-68abb6b1-5c6f-4b20-8297-69323e7bbbf1 service nova] Creating event network-changed:5d8bf27f-a758-4118-ae21-8e85de0af835 for instance 9b9ca45e-085c-4ccf-a6b5-36960297291b on hv-cinder-85919 Sep 24 19:50:29.232792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-855afc13-13f2-4325-b838-1a0b0d9e2cfb req-68abb6b1-5c6f-4b20-8297-69323e7bbbf1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035768 Sep 24 19:50:29.233756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 368/785] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:29.280018 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:29.281582 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:29.290139 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:29.290985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:29.291673 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:29.295843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:29.295843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:29.295843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:29.480666 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:29.490497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5e0e6d31-eb09-4dfb-b509-e297a143ff66 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1549 microversion: 2.1 time: 0.215777 Sep 24 19:50:29.491304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 418/786] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:29 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:29.514196 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:29.514806 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:29.517395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:29.523296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:29.524108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:29.524801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:29.525703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:29.526344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:29.527030 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:29.681579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3239dbf6-2b48-4ce9-801b-0edf4fa5051c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171785 Sep 24 19:50:29.690153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 369/787] 10.222.0.55 () {58 vars in 1275 bytes} [Sat Sep 24 19:50:29 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:30.008063 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:30.008749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:30.021538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:30.024933 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:30.025394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:30.026151 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:30.026620 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:30.027050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:30.569915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:30.580122 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-95d1bc53-0e77-43c6-8744-53ef06c63f1b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.576026 Sep 24 19:50:30.581255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 419/788] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:30 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:31.078341 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:31.079704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:31.085664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:31.086182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:31.086719 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:31.087521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:31.088328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:31.088959 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:31.119335 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f3c4d283-f961-42d4-912d-ed89aaf376de tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/ips" status: 200 len: 150 microversion: 2.20 time: 0.307679 Sep 24 19:50:31.120229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 370/789] 10.222.0.55 () {60 vars in 1289 bytes} [Sat Sep 24 19:50:30 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/ips => generated 150 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:50:31.251347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-5c953f10-df5e-442a-9bda-7a74241c1dcb req-bf590d9e-57d1-4c40-8696-8e3aeeb6f226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0", "tag": "31356b09-48e8-4e8f-8d96-f589c823cfae"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:31.268234 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-5c953f10-df5e-442a-9bda-7a74241c1dcb req-bf590d9e-57d1-4c40-8696-8e3aeeb6f226 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:31.270672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-5c953f10-df5e-442a-9bda-7a74241c1dcb req-bf590d9e-57d1-4c40-8696-8e3aeeb6f226 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:31.272185 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-5c953f10-df5e-442a-9bda-7a74241c1dcb req-bf590d9e-57d1-4c40-8696-8e3aeeb6f226 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:31.285831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-5c953f10-df5e-442a-9bda-7a74241c1dcb req-bf590d9e-57d1-4c40-8696-8e3aeeb6f226 service nova] Creating event network-changed:31356b09-48e8-4e8f-8d96-f589c823cfae for instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 on hv-cinder-85919 Sep 24 19:50:31.293567 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-5c953f10-df5e-442a-9bda-7a74241c1dcb req-bf590d9e-57d1-4c40-8696-8e3aeeb6f226 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047046 Sep 24 19:50:31.294846 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 420/790] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:50:31.605408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:31.606139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:31.620112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:31.620651 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:31.622291 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:31.623055 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:31.623585 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:31.624024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:31.885490 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:31.898198 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cc30b25c-b9bc-4656-8333-81ddd797b423 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.297206 Sep 24 19:50:31.899932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 371/791] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:31 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:32.925045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:32.925736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:32.932362 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:32.932636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:32.933078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:32.933792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:32.934261 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:32.934690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:33.084475 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:33.085001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:33.096458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:33.096954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:33.097392 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:33.098102 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:33.098560 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:33.100003 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:33.106891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:33.117779 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-75f34151-6003-49f9-9182-d6870d63f99b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.199036 Sep 24 19:50:33.118396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 421/792] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:32 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:33.131575 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lazy-loading 'flavor' on Instance uuid 2c550fec-675d-43cd-9f53-9d9e3393ce01 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:50:33.329371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c17529fb-0c61-4804-a5b7-b1c8e8d481d2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/action" status: 202 len: 0 microversion: 2.20 time: 0.248531 Sep 24 19:50:33.332951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 372/793] 10.222.0.55 () {62 vars in 1319 bytes} [Sat Sep 24 19:50:33 2022] POST /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:50:33.338766 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:33.339303 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:33.346691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:33.347237 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:33.347732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:33.348434 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:33.348896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:33.349327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:33.493759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:33.499472 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:33.500981 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:33.502164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f73a22cf-f1d6-42db-910d-84a03b8222b4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.167826 Sep 24 19:50:33.502724 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 422/794] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:33 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:34.142440 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:34.143154 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:34.150028 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:34.150525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:34.150966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:34.151704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:34.152163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:34.152587 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:34.306626 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:34.309078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:34.317240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e11264ea-0330-4743-be84-b76014e77d82 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.179792 Sep 24 19:50:34.317858 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 373/795] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:34 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:34.528805 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:34.529428 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:34.537202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:34.538227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:34.538227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:34.538840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:34.539307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:34.539765 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:34.687403 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:34.695930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:34.697419 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:34.698623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-80db435a-162a-48f2-9993-a5cab2fae67e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.174533 Sep 24 19:50:34.699184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 423/796] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:34 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:35.341385 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:35.343615 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:35.350735 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.351229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.351706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.352412 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.352878 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.353311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.529227 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:35.551160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5f4dcdef-3e49-419e-9240-f553e6235861 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1570 microversion: 2.1 time: 0.214288 Sep 24 19:50:35.552041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 374/797] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:35 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:35.574831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:35.575471 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:35.582313 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.582824 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.583267 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.584891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.585367 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.585835 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.624937 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127045) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 19:50:35.700634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ede4a192-41ec-4d7e-a57a-27cd57980e9a tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "POST /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8/action" status: 202 len: 0 microversion: 2.1 time: 0.129750 Sep 24 19:50:35.701533 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 424/798] 10.222.0.55 () {60 vars in 1278 bytes} [Sat Sep 24 19:50:35 2022] POST /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:50:35.710299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:35.710940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:35.717483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.718303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.719236 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.720117 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.720726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.721244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.730910 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:35.731980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:35.740938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.741693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.742152 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.742923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:35.743468 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:35.744053 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:35.939366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:35.941833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:35.953257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:35.955211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:35.956530 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-71ef4e96-db71-44a4-9dee-9aaba489726b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.234329 Sep 24 19:50:35.957157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 425/799] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:35 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:35.988076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:35.996396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bfcd98c7-a074-474d-a762-cca1e9f13293 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1518 microversion: 2.1 time: 0.290011 Sep 24 19:50:35.997269 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 375/800] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:35 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1518 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:36.985138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:36.985746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:36.993402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:36.993961 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:36.994331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:36.995037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:36.997239 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:36.997239 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:37.025105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:37.026320 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:37.037290 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:37.037786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:37.038229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:37.038929 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:37.039587 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:37.040019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:37.192427 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:37.206752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:37.208414 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:37.209912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ab06f402-2eaf-456c-81ea-a2d518d69e5a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.229734 Sep 24 19:50:37.210931 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 426/801] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:36 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:37.211582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:37.223399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3308ef73-dd6c-4ca9-8f5e-25fa78449002 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1520 microversion: 2.1 time: 0.202351 Sep 24 19:50:37.223399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 376/802] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:37 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:38.238844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:38.238844 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:38.244016 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:38.244647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:38.246023 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:38.246557 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:38.246934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:38.247811 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:38.248266 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:38.248565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:38.252129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:38.252680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:38.253084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:38.253809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:38.254302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:38.255212 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:38.420692 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:38.442425 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:38.442632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-07fc0509-6d3b-46f7-a948-6f7381186b21 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.202276 Sep 24 19:50:38.443231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 377/803] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:38 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:38.462429 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:38.464037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:38.465382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-abfa8202-5f33-4fa3-8643-f5bc6efdb990 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.231666 Sep 24 19:50:38.466484 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 427/804] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:38 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:38.714981 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-b8b050c8-beb5-42cd-92f4-fafc0b775500 req-f17579e5-e211-4724-ac88-7990da8af929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef25795-8222-4f8a-9427-86abea7da3d8", "name": "network-vif-unplugged", "status": "completed", "tag": "5e05d20f-c1e7-402f-9255-05129dfbe981"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:38.726315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-b8b050c8-beb5-42cd-92f4-fafc0b775500 req-f17579e5-e211-4724-ac88-7990da8af929 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:38.727084 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-b8b050c8-beb5-42cd-92f4-fafc0b775500 req-f17579e5-e211-4724-ac88-7990da8af929 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:38.727559 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-b8b050c8-beb5-42cd-92f4-fafc0b775500 req-f17579e5-e211-4724-ac88-7990da8af929 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:38.741695 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-b8b050c8-beb5-42cd-92f4-fafc0b775500 req-f17579e5-e211-4724-ac88-7990da8af929 service nova] Creating event network-vif-unplugged:5e05d20f-c1e7-402f-9255-05129dfbe981 for instance 4ef25795-8222-4f8a-9427-86abea7da3d8 on hv-cinder-85919 Sep 24 19:50:38.747995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-b8b050c8-beb5-42cd-92f4-fafc0b775500 req-f17579e5-e211-4724-ac88-7990da8af929 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182574 Sep 24 19:50:38.749300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 378/805] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:39.468437 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:39.469280 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:39.475811 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:39.476301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:39.476768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:39.477470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:39.477982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:39.478411 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:39.493609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:39.494315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:39.501127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:39.501606 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:39.502048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:39.502749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:39.503205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:39.503669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:39.616939 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:39.625760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0ae7fb86-8cae-4fc4-9906-1ed818dcc617 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.161857 Sep 24 19:50:39.626341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 428/806] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:39 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:39.645557 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:39.653715 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:39.655172 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:39.656612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-25cd8fc6-aab6-45c7-a923-6fc82814443c tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.167309 Sep 24 19:50:39.657201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 379/807] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:39 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:40.649921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:40.650538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:40.657295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:40.657783 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:40.658225 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:40.658940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:40.659406 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:40.659859 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:40.682316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:40.683096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:40.690677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:40.691197 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:40.691658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:40.692363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:40.692850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:40.693278 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:40.796416 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:40.805269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-dd72b6a0-40ae-414a-ac75-e779f37c9527 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.159212 Sep 24 19:50:40.805854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 429/808] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:40 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:40.831351 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:40.839997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:40.841647 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:40.843092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c6080e16-7dff-45b8-b7ff-c1a26965e63a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.164705 Sep 24 19:50:40.844039 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 380/809] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:40 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:41.830740 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:41.831295 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:41.837834 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:41.838336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:41.838781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:41.839515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:41.839987 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:41.840497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:41.869168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:41.869787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:41.877141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:41.877634 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:41.878071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:41.878771 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:41.879230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:41.879682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:41.975676 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:41.983697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ab789574-bf94-4532-90e8-58346e6d5764 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.157412 Sep 24 19:50:41.984503 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 430/810] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:41 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:42.011956 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:42.021088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:42.022553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:42.023734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c780ff3f-8030-463b-84d2-47ea419b7ce3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.158398 Sep 24 19:50:42.024299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 381/811] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:41 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:43.007733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:43.008372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:43.015527 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:43.016019 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:43.016457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:43.017155 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:43.017614 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:43.018037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:43.049315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:43.049949 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:43.057123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:43.057630 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:43.058082 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:43.058809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:43.059278 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:43.059750 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:43.162259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:43.170475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c6c139c3-ceb1-46f1-8f11-5ed566733b41 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.166754 Sep 24 19:50:43.171217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 431/812] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:43 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:43.192796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:43.202719 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:43.204693 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:43.205927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-db7a6958-4bb0-4d8b-bd98-45354357d519 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.160941 Sep 24 19:50:43.206560 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 382/813] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:43 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:44.194136 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:44.194727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:44.201347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:44.201831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:44.202846 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:44.203756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:44.204223 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:44.204651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:44.232409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:44.233035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:44.240127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:44.240629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:44.241074 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:44.241788 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:44.242255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:44.242693 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:44.339856 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:44.348078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c3dc2bfe-0b06-40d8-80ed-e5800d09b57e tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.157778 Sep 24 19:50:44.348650 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 432/814] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:44 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:44.383231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:44.392479 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:44.393934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:44.395095 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-19491900-6738-4db7-be8b-246d7147fb92 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.166741 Sep 24 19:50:44.395689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 383/815] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:44 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:45.371721 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:45.372254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:45.379530 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:45.380031 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:45.380479 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:45.381191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:45.381661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:45.382100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:45.420141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:45.421303 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:45.428438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:45.428976 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:45.429389 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:45.430162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:45.430567 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:45.430996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:45.521878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:45.529985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c38cc71f-88c2-4365-b168-b7b748a0d362 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.162226 Sep 24 19:50:45.530659 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 433/816] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:45 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:45.571670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:45.580044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:45.581510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:45.582675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cd9c679f-c50f-4f1d-9e7d-62a7e5b88b98 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.166728 Sep 24 19:50:45.583241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 384/817] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:45 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:46.553272 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:46.553892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:46.557307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:46.560995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:46.561692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:46.562242 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:46.562959 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:46.563448 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:46.563883 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:46.609312 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:46.609935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:46.616616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:46.617123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:46.617573 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:46.618295 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:46.618762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:46.619255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:46.706182 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:46.714314 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ec951d8a-5502-4b3e-8eda-54c4d44f0f13 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.164942 Sep 24 19:50:46.715092 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 434/818] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:46 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:46.759326 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:46.767757 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:46.769194 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:46.770359 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4237a658-9840-4990-b5bd-1806a30f9a5b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.165595 Sep 24 19:50:46.770920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 385/819] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:46 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:47.738353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:47.738975 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:47.745480 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:47.745966 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:47.746409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:47.747107 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:47.747612 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:47.748045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:47.797005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:47.797727 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:47.804402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:47.804951 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:47.805396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:47.806112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:47.806578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:47.807015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:47.890251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:47.898542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-bf61575b-df2c-47a0-a11c-762251adc731 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1576 microversion: 2.1 time: 0.164097 Sep 24 19:50:47.899119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 435/820] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:47 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:47.944537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:47.953410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:47.954868 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:47.956075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-372a196d-4460-44f1-9fc5-34c1b30f7dab tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.164253 Sep 24 19:50:47.956646 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 386/821] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:47 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:48.923403 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:48.923921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:48.931037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:48.931689 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:48.932284 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:48.933042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:48.933507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:48.933935 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:48.982320 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:48.982957 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:48.989704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:48.990204 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:48.990649 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:48.991363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:48.991856 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:48.992284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:49.136592 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:49.147872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-af04cf51-d336-4c6a-9e85-76b235722e89 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1563 microversion: 2.1 time: 0.229268 Sep 24 19:50:49.168109 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 436/822] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:50:48 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:50:49.206758 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:49.215554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:49.217324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:49.219488 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-752bdee2-aeb6-4bdd-a463-1729c2a9534e tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.241469 Sep 24 19:50:49.220064 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 387/823] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:48 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:50.246215 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:50.246841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:50.259672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:50.259672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:50.259672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:50.259672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:50.260037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:50.260037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:50.400160 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:50.408953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:50.416037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:50.416037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-8426515c-4fb0-45e3-832d-faef883e99b9 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.169390 Sep 24 19:50:50.416037 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 437/824] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:50 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:50.766971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-a199ed5c-3364-4aca-bcd9-74dd75b0d0c5 req-fc2401c0-535e-4d32-b9c0-65f3938a5f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef25795-8222-4f8a-9427-86abea7da3d8", "name": "network-vif-plugged", "status": "completed", "tag": "5e05d20f-c1e7-402f-9255-05129dfbe981"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:50.778731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a199ed5c-3364-4aca-bcd9-74dd75b0d0c5 req-fc2401c0-535e-4d32-b9c0-65f3938a5f39 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:50.780349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a199ed5c-3364-4aca-bcd9-74dd75b0d0c5 req-fc2401c0-535e-4d32-b9c0-65f3938a5f39 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:50.781094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a199ed5c-3364-4aca-bcd9-74dd75b0d0c5 req-fc2401c0-535e-4d32-b9c0-65f3938a5f39 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:50.792790 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-a199ed5c-3364-4aca-bcd9-74dd75b0d0c5 req-fc2401c0-535e-4d32-b9c0-65f3938a5f39 service nova] Creating event network-vif-plugged:5e05d20f-c1e7-402f-9255-05129dfbe981 for instance 4ef25795-8222-4f8a-9427-86abea7da3d8 on hv-cinder-85919 Sep 24 19:50:50.798904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-a199ed5c-3364-4aca-bcd9-74dd75b0d0c5 req-fc2401c0-535e-4d32-b9c0-65f3938a5f39 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035665 Sep 24 19:50:50.799801 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 388/825] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:51.438604 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:51.439250 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:51.445739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:51.446230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:51.446676 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:51.447383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:51.447875 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:51.448310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:51.589367 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:51.598327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:51.599824 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:51.600995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e0fd3a5b-bcad-460a-a6db-4ff3735d41bc tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.167085 Sep 24 19:50:51.601548 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 438/826] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:51 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:52.627249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:52.627910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:52.634728 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:52.635210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:52.635678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:52.636371 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:52.636828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:52.637254 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:52.768037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:52.776512 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:52.777959 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:52.779108 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7bdbbbda-237d-4d2d-be0d-269af1b4e8f1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.156635 Sep 24 19:50:52.779712 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 389/827] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:52 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:53.805698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:53.806370 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:53.814959 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:53.815463 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:53.816394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:53.817273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:53.818254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:53.818730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:54.055081 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:54.065063 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:54.066614 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:54.067786 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-04631de1-e717-42a3-88a2-98163ab5adcf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1742 microversion: 2.20 time: 0.266038 Sep 24 19:50:54.068351 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 439/828] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:53 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1742 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:50:55.100330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:55.100330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:55.108570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:55.109067 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:55.109501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:55.110502 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:55.110964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:55.111687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:55.247721 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:55.259230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:55.261638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:55.262816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-27fc38ce-7c4b-4c3d-a64b-a596a3ac1860 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1742 microversion: 2.20 time: 0.171827 Sep 24 19:50:55.263493 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 390/829] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:55 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:56.288500 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:56.289131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:56.297506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:56.298235 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:56.298677 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:56.299385 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:56.299876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:56.300281 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:56.444764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:56.453623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:56.455318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:56.456626 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e82d05a5-df2d-45cf-9865-45c165e5e6b1 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1742 microversion: 2.20 time: 0.172080 Sep 24 19:50:56.457266 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 440/830] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:56 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:56.679296 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-16636795-3b99-4e2c-8ed7-78db1db1ee3e req-3137f47e-76d5-469e-b889-f47dc980b4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c550fec-675d-43cd-9f53-9d9e3393ce01", "name": "network-vif-plugged", "status": "completed", "tag": "d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:50:56.691282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-16636795-3b99-4e2c-8ed7-78db1db1ee3e req-3137f47e-76d5-469e-b889-f47dc980b4cb service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:56.692703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-16636795-3b99-4e2c-8ed7-78db1db1ee3e req-3137f47e-76d5-469e-b889-f47dc980b4cb service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:56.693486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-16636795-3b99-4e2c-8ed7-78db1db1ee3e req-3137f47e-76d5-469e-b889-f47dc980b4cb service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:56.708378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-16636795-3b99-4e2c-8ed7-78db1db1ee3e req-3137f47e-76d5-469e-b889-f47dc980b4cb service nova] Creating event network-vif-plugged:d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26 for instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 on hv-cinder-85919 Sep 24 19:50:56.715774 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-16636795-3b99-4e2c-8ed7-78db1db1ee3e req-3137f47e-76d5-469e-b889-f47dc980b4cb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040226 Sep 24 19:50:56.716258 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 391/831] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:50:57.486885 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:57.487664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:57.494244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:57.494756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:57.498310 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:57.499107 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:57.499730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:57.500061 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:57.692192 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:57.706322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:57.709226 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:57.711395 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-caee9668-cf7b-4e0b-8c72-6082cc44b423 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.232889 Sep 24 19:50:57.712732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 441/832] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:57 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:50:58.746932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:50:58.748192 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:50:58.756787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:58.757552 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:58.758339 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:58.759373 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:50:58.760156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:50:58.760743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:50:58.781007 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=100 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:50:59.000982 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:59.009749 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:59.011223 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:50:59.012439 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6780b300-63ca-441b-937d-f1be7b853f88 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.271437 Sep 24 19:50:59.023514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 392/833] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:50:58 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:00.038995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:00.040600 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:00.047839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:00.049976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:00.050596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:00.051496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:00.052116 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:00.052780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:00.078019 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=100 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:00.241160 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:00.252023 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:00.253570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:00.255018 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-12ee2728-f15b-455b-9f39-29d6930e0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.220421 Sep 24 19:51:00.256142 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 442/834] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:00 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:01.284173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:01.285425 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:01.287595 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=48 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:01.293150 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:01.293657 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:01.294101 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:01.295831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:01.296671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:01.297252 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:01.468992 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:01.479189 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:01.480860 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:01.482240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-98e3ae34-8078-4abb-b04a-7999a97206da tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.203321 Sep 24 19:51:01.495484 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 393/835] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:01 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:02.146423 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1314638902", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "networks": [{"uuid": "ad49e007-fa2a-411f-8eef-41c1c78b2d91"}]}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:02.216873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] validate_networks() for [('ad49e007-fa2a-411f-8eef-41c1c78b2d91', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:51:02.509486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:02.510903 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:02.519899 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:02.520819 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:02.521522 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:02.522627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:02.523317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:02.524053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:02.646439 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:51:02.647276 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:51:02.647951 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:51:02.648711 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:51:02.649617 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:51:02.661569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:02.663706 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:02.664582 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:02.666581 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:02.667324 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:02.668057 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:02.690919 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Getting quotas for project bd71c6be7e9d4741b129fbc0e6fafad4. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:51:02.695978 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Getting quotas for user 875e4edde2834c8d9fd40cb219c4d2fd and project bd71c6be7e9d4741b129fbc0e6fafad4. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:51:02.711461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:02.714607 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:51:02.718525 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:51:02.727494 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:02.729362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:02.730655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-491e7ce4-39c1-4c90-bfc1-739d6bce0bc3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.225351 Sep 24 19:51:02.731782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 394/836] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:02 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:02.775488 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4546d7dc-09c1-42e4-aaee-ec42d98c77e2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632934 Sep 24 19:51:02.776095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 443/837] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:51:02.797588 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-08f7b19e-c32f-47e1-ae56-bef71372cd4c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:02.799294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-08f7b19e-c32f-47e1-ae56-bef71372cd4c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:02.890445 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-08f7b19e-c32f-47e1-ae56-bef71372cd4c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:02.899180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-08f7b19e-c32f-47e1-ae56-bef71372cd4c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1219 microversion: 2.1 time: 0.106556 Sep 24 19:51:02.903507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 395/838] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:02 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:03.759086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:03.760885 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:03.771244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:03.772038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:03.773129 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:03.774271 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:03.774902 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:03.775621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:03.924496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:03.925135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:03.942489 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:03.945717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:03.946171 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:03.947145 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:03.947978 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:03.948638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:04.046045 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:04.057716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-aa5129c0-6662-4e9e-a1e1-1a147f9eac71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1271 microversion: 2.1 time: 0.139045 Sep 24 19:51:04.058792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 396/839] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:03 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:04.234150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:04.243929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:04.245704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:04.247065 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9e693267-341a-4d38-9667-e7240df7e49f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.493436 Sep 24 19:51:04.248282 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 444/840] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:03 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:05.084331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:05.085699 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:05.093825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:05.094612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:05.095231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:05.096174 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:05.096814 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:05.097428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:05.206586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:05.222945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a068b849-dd79-4422-ba2f-435e78e1f30a tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1277 microversion: 2.1 time: 0.143278 Sep 24 19:51:05.228175 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 397/841] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:05 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:05.281024 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:05.282346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:05.297496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:05.298431 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:05.299060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:05.300073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:05.300742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:05.301372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:05.558566 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:05.569200 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:05.570760 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:05.572100 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-72b4f56d-e0f6-4807-95b8-6e2e16a60396 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.295870 Sep 24 19:51:05.572678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 445/842] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:05 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:06.249890 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:06.250535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:06.257529 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:06.258030 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:06.258679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:06.259780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:06.260422 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:06.261019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:06.415015 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-493226cd-b522-4ce5-b1fe-0188f5b720e2 req-8e4c5cd7-c944-4a31-9a84-80b3c0c8179c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a085d2af-3858-4503-a642-448b4fc1330f", "tag": "e8ccdf98-f282-4b7f-a739-d913fe993d4b"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:06.436768 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-493226cd-b522-4ce5-b1fe-0188f5b720e2 req-8e4c5cd7-c944-4a31-9a84-80b3c0c8179c service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:06.437079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-493226cd-b522-4ce5-b1fe-0188f5b720e2 req-8e4c5cd7-c944-4a31-9a84-80b3c0c8179c service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:06.437550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-493226cd-b522-4ce5-b1fe-0188f5b720e2 req-8e4c5cd7-c944-4a31-9a84-80b3c0c8179c service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:06.469441 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-493226cd-b522-4ce5-b1fe-0188f5b720e2 req-8e4c5cd7-c944-4a31-9a84-80b3c0c8179c service nova] Creating event network-changed:e8ccdf98-f282-4b7f-a739-d913fe993d4b for instance a085d2af-3858-4503-a642-448b4fc1330f on hv-cinder-85919 Sep 24 19:51:06.472583 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:06.483618 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5d82801f-271d-46c2-989e-5f093a05a0cc tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1319 microversion: 2.1 time: 0.237884 Sep 24 19:51:06.484569 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 398/843] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:06 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:51:06.527323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-493226cd-b522-4ce5-b1fe-0188f5b720e2 req-8e4c5cd7-c944-4a31-9a84-80b3c0c8179c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116263 Sep 24 19:51:06.528184 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 446/844] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:51:06.601322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:06.602033 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:06.612151 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:06.613586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:06.613586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:06.614363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:06.614947 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:06.615472 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:06.801592 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:06.810683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:06.812287 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:06.813524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2cd7af25-1f9f-478f-bf15-4611526e1978 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1737 microversion: 2.20 time: 0.216198 Sep 24 19:51:06.814095 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 399/845] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:06 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:07.514915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:07.515678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:07.521958 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:07.522459 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:07.522899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:07.523636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:07.524099 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:07.524531 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:07.662264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:07.670927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a6013482-034f-46d5-91a0-48175ec1054f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1319 microversion: 2.1 time: 0.160875 Sep 24 19:51:07.671597 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 447/846] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:07 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:51:07.838865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:07.839464 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:07.847767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:07.848435 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:07.849193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:07.849907 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:07.850370 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:07.850800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:07.987552 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:07.995954 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:07.997422 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:07.998589 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-83e0004c-19b0-4727-9696-f2017da8d9c5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1719 microversion: 2.20 time: 0.164173 Sep 24 19:51:07.999160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 400/847] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:07 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:08.698495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:08.700206 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:08.707858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:08.708695 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:08.709327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:08.710273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:08.710940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:08.711617 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:08.926816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:08.934794 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6147654c-df3e-4847-8b10-1cf1f58ce7fd tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1319 microversion: 2.1 time: 0.243716 Sep 24 19:51:08.935369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 448/848] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:08 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:09.024153 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:09.024751 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:09.032409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:09.032908 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:09.033356 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:09.034128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:09.034596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:09.035032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:09.173776 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:09.182079 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:09.183591 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:09.184762 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-07359ba4-6d8b-48e2-ae2b-9cda1461653b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1719 microversion: 2.20 time: 0.164562 Sep 24 19:51:09.185322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 401/849] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:09 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:09.957225 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:09.957846 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:09.964495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:09.964986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:09.965424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:09.966129 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:09.966585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:09.967675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:10.099986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:10.107863 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1d42c6b8-b644-440a-af2b-b5b68e60bb7f tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1319 microversion: 2.1 time: 0.154557 Sep 24 19:51:10.108469 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 449/850] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:09 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:51:10.210434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:10.210990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:10.218021 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:10.218500 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:10.218935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:10.219656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:10.220111 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:10.220539 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:10.350718 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:10.359300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:10.360807 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:10.361958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3923d391-8504-4046-99c6-f5790cc91e52 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1719 microversion: 2.20 time: 0.155594 Sep 24 19:51:10.362519 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 402/851] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:10 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:10.753159 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-a1e8a727-b6b1-4093-b8f7-2e3ffa0e4c72 req-e8e2a3b4-c0ab-489f-ac9a-9e1981d28ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a085d2af-3858-4503-a642-448b4fc1330f", "name": "network-vif-plugged", "status": "completed", "tag": "e8ccdf98-f282-4b7f-a739-d913fe993d4b"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:10.763827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-a1e8a727-b6b1-4093-b8f7-2e3ffa0e4c72 req-e8e2a3b4-c0ab-489f-ac9a-9e1981d28ad0 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:10.764574 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-a1e8a727-b6b1-4093-b8f7-2e3ffa0e4c72 req-e8e2a3b4-c0ab-489f-ac9a-9e1981d28ad0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:10.765178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-a1e8a727-b6b1-4093-b8f7-2e3ffa0e4c72 req-e8e2a3b4-c0ab-489f-ac9a-9e1981d28ad0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:10.776851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-a1e8a727-b6b1-4093-b8f7-2e3ffa0e4c72 req-e8e2a3b4-c0ab-489f-ac9a-9e1981d28ad0 service nova] Creating event network-vif-plugged:e8ccdf98-f282-4b7f-a739-d913fe993d4b for instance a085d2af-3858-4503-a642-448b4fc1330f on hv-cinder-85919 Sep 24 19:51:10.782485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-a1e8a727-b6b1-4093-b8f7-2e3ffa0e4c72 req-e8e2a3b4-c0ab-489f-ac9a-9e1981d28ad0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033687 Sep 24 19:51:10.783095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 450/852] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:11.130127 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:11.130840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:11.137157 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:11.137648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:11.138089 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:11.138814 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:11.139273 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:11.139842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:11.269448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:11.277201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d59435da-971c-434c-b92c-658a3ac95db6 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1319 microversion: 2.1 time: 0.150914 Sep 24 19:51:11.277779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 403/853] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:11 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:11.388409 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:11.389067 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:11.395362 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:11.395888 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:11.396334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:11.397170 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:11.397635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:11.398106 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:11.533079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:11.541248 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:11.542703 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:11.543904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-79a4235b-42b6-47e9-adf3-dbda9edb5f99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1722 microversion: 2.20 time: 0.160390 Sep 24 19:51:11.544717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 451/854] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:11 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:11.568790 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46ee626e-16bc-4e7a-8dc0-f16d7706eeda"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:11.571101 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:11.577902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:11.578395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:11.578836 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:11.579568 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:11.580032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:11.580459 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:11.865075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-07f83b24-ebb2-4c21-add5-d525bf96d1c7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300243 Sep 24 19:51:11.865729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 404/855] 10.222.0.55 () {62 vars in 1364 bytes} [Sat Sep 24 19:51:11 2022] POST /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 19:51:11.997606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:11.998597 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:12.004616 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.005107 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.005548 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.006246 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.006710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.007140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.253987 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-cac93c8b-e2f8-4297-9f59-7289fc703b39 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-volume_attachments/46ee626e-16bc-4e7a-8dc0-f16d7706eeda" status: 202 len: 0 microversion: 2.20 time: 0.260262 Sep 24 19:51:12.254578 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 452/856] 10.222.0.55 () {60 vars in 1457 bytes} [Sat Sep 24 19:51:11 2022] DELETE /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-volume_attachments/46ee626e-16bc-4e7a-8dc0-f16d7706eeda => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:51:12.301591 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:12.302215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:12.312045 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.312547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.313121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.313845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.314360 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.314764 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.319080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:12.319717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:12.329414 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.330050 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.330736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.331745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.332321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.332897 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.371080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127045) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 19:51:12.444441 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-40c6c8bd-50e9-4797-8ca7-8332f6c5d0e4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "POST /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/action" status: 202 len: 0 microversion: 2.20 time: 0.129960 Sep 24 19:51:12.445134 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 453/857] 10.222.0.55 () {62 vars in 1319 bytes} [Sat Sep 24 19:51:12 2022] POST /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:51:12.453588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:12.454204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:12.460243 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.460739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.461181 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.461894 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.462357 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.462788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.465510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:12.477434 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c8068f9a-a152-4127-92be-8992308cbf5e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1319 microversion: 2.1 time: 0.179691 Sep 24 19:51:12.478096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 405/858] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:12 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:12.599983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:12.608298 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:12.609898 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:12.611279 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b752f90f-332a-47ed-8c97-b6f1e58fbcbb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1670 microversion: 2.20 time: 0.162134 Sep 24 19:51:12.611882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 454/859] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:12 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:12.808293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-dc8c20e0-0963-43d3-bacf-d3191b5f70d3 req-d32491d8-7f06-430a-94b4-9b1c860ac36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c550fec-675d-43cd-9f53-9d9e3393ce01", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:12.818375 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-dc8c20e0-0963-43d3-bacf-d3191b5f70d3 req-d32491d8-7f06-430a-94b4-9b1c860ac36e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:12.818996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-dc8c20e0-0963-43d3-bacf-d3191b5f70d3 req-d32491d8-7f06-430a-94b4-9b1c860ac36e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:12.819609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-dc8c20e0-0963-43d3-bacf-d3191b5f70d3 req-d32491d8-7f06-430a-94b4-9b1c860ac36e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:12.832354 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.compute.server_external_events [req-dc8c20e0-0963-43d3-bacf-d3191b5f70d3 req-d32491d8-7f06-430a-94b4-9b1c860ac36e service nova] Unable to find a host for instance 2c550fec-675d-43cd-9f53-9d9e3393ce01. Dropping event network-vif-unplugged {{(pid=127046) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 19:51:12.833241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-dc8c20e0-0963-43d3-bacf-d3191b5f70d3 req-d32491d8-7f06-430a-94b4-9b1c860ac36e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028958 Sep 24 19:51:12.834041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 406/860] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 24 19:51:13.126279 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:13.126778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:13.128735 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:13.129535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:13.135189 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:13.135721 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:13.136161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:13.136868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:13.137328 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:13.137759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:13.168825 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fd33f9d9-0d27-476f-a7c8-0a4b4c7590de tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/ips" status: 200 len: 150 microversion: 2.1 time: 0.046750 Sep 24 19:51:13.169664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 455/861] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:51:13 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:13.500839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:13.502148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:13.505380 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:13.509573 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:13.510128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:13.510597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:13.511418 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:13.511889 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:13.512316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:13.639606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:13.640475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:13.648222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:13.650232 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:13.650697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:13.651210 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:13.652027 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:13.652561 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:13.653328 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:13.657266 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d38a3f99-0988-4a59-b9eb-d7e34f3dae36 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1508 microversion: 2.1 time: 0.160989 Sep 24 19:51:13.658114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 407/862] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:13 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:13.795927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:13.805539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:13.806857 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:13.808081 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c3a68f82-18d0-40c0-ac50-bf860c732b99 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.173794 Sep 24 19:51:13.808631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 456/863] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:13 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:14.540609 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fb54a58-c3ef-4540-afa3-617bafe92e3b"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:14.543682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:14.551396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:14.552040 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:14.552616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:14.553458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:14.553977 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:14.554530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:14.572323 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:14.834733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:14.835494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:14.843170 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:14.844013 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:14.844690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:14.845733 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:14.846471 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:14.847253 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:14.887220 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-60f64271-2fb5-493f-9eb6-d604b37926f3 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "POST /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349272 Sep 24 19:51:14.887910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 408/864] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:51:14 2022] POST /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:15.076147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:15.077693 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:15.089924 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:15.094548 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:15.101580 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:15.102019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:15.102460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:15.103190 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:15.103688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:15.104128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:15.112535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:15.127586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:15.129113 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-151e581a-0a39-40f9-9d61-1823e0ecfb30 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.298563 Sep 24 19:51:15.136230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 457/865] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:14 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:15.145803 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-628d0533-4c14-429f-9d56-86fc610f890e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/ips" status: 200 len: 146 microversion: 2.1 time: 0.068630 Sep 24 19:51:15.147129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 409/866] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:51:15 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/ips => generated 146 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:16.166367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:16.167076 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:16.174270 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:16.174755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:16.175189 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:16.175905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:16.176359 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:16.176782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:16.349445 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:16.358891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:16.360437 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:16.361611 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-820c6e0a-acb0-4e26-8283-bbe010627262 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.199168 Sep 24 19:51:16.362180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 410/867] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:16 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:16.635541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32e70543-c1c2-4ce5-aa25-61f9d40fd850"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:16.638756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:16.641398 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:16.647557 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:16.648059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:16.648499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:16.649234 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:16.649696 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:16.650128 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:17.386857 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:17.387623 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:17.397987 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:17.398669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:17.399129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:17.400065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:17.400731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:17.401173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:17.572628 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:17.582457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:17.584251 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:17.585589 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-84616544-f9a7-4473-a711-92d48f21de0a tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.203248 Sep 24 19:51:17.586162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 411/868] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:17 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:18.618137 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:18.621416 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:18.637481 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:18.639409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:18.640419 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:18.641864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:18.642880 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:18.643842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:18.809326 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:18.818558 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:18.820053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:18.821223 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e6695c14-b2ce-47f1-804c-61289508eeaf tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.211639 Sep 24 19:51:18.821782 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 412/869] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:18 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:19.847755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:19.848450 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:19.855011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:19.855553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:19.855998 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:19.856713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:19.857182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:19.857885 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:20.021900 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:20.048944 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:20.050433 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:20.051662 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-09d14500-a9c3-42ba-86eb-a4bd89ddc917 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.207908 Sep 24 19:51:20.052236 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 413/870] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:19 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:21.078145 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:21.078856 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:21.085683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:21.086180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:21.086617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:21.087325 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:21.087813 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:21.088461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:21.234904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:21.244613 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:21.248099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:21.248099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bdf20e75-7e65-47c2-b139-71737ce16f5d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.172966 Sep 24 19:51:21.248099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 414/871] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:21 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:22.274082 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:22.274797 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:22.282481 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:22.282955 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:22.283398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:22.284139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:22.284596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:22.285019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:22.448206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:22.465546 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:22.468946 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:22.474071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a2d6fa7f-8ad5-4bb4-a1bc-4c3176f90e9f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.204067 Sep 24 19:51:22.474656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 415/872] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:22 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:23.502319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:23.503097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:23.509895 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:23.510389 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:23.511005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:23.511769 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:23.512232 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:23.512734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:23.658097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:23.666327 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:23.668099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:23.669516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-26381bf3-1e6d-4ac3-9528-dfa3b33c2d86 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.170999 Sep 24 19:51:23.679468 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 416/873] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:23 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:24.695125 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:24.695870 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:24.703145 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:24.703674 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:24.704112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:24.704826 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:24.705282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:24.705706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:24.853321 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:24.862964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:24.864491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:24.865724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-594162b5-156a-4980-b981-94560714fa4d tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.174645 Sep 24 19:51:24.866307 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 417/874] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:24 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:51:25.457135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ac099626-f2a1-438d-9f5d-d85e1a5ed67f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.826193 Sep 24 19:51:25.457740 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 458/875] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:51:16 2022] POST /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments => generated 194 bytes in 8828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:25.892795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:25.893573 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:25.899952 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:25.900444 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:25.900891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:25.901597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:25.902053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:25.902484 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:26.051771 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:26.061661 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:26.063351 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:26.074343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-eef44344-a723-431d-8b21-634dc47e4ad5 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.176515 Sep 24 19:51:26.074343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 418/876] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:25 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:26.898545 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:26.899149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:26.901826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:26.908732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:26.909233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:26.909678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:26.910394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:26.910857 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:26.911289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:26.995915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lazy-loading 'services' on Instance uuid 9b9ca45e-085c-4ccf-a6b5-36960297291b {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:51:27.078662 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-622435ee-8de8-4599-8e95-6cb45f3f15db tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments/9fb54a58-c3ef-4540-afa3-617bafe92e3b" status: 202 len: 0 microversion: 2.1 time: 0.185696 Sep 24 19:51:27.079348 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 459/877] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:51:26 2022] DELETE /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments/9fb54a58-c3ef-4540-afa3-617bafe92e3b => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:51:27.091139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:27.094546 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:27.097965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:27.099412 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:27.101855 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:27.102486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:27.102940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:27.103695 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:27.104161 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:27.104596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:27.112652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:27.113534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:27.114326 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:27.115672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:27.116674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:27.117495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:27.136912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e9d05c62-624d-4f18-95d9-85ea914cd4c8 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049765 Sep 24 19:51:27.137496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 419/878] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:27 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:51:27.266227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:27.274764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:27.276278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:27.277456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-783a90f7-5a40-493e-a582-af3071c25565 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.188307 Sep 24 19:51:27.278015 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 460/879] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:27 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:28.152682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:28.155645 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:28.162065 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:28.162554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:28.162997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:28.163711 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:28.164197 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:28.164606 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:28.194563 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-735778d2-aa48-442b-80d0-166acb4d2d6e tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Sep 24 19:51:28.195043 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 420/880] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:28 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:28.302917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:28.303577 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:28.310628 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:28.311235 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:28.311797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:28.312495 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:28.312955 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:28.313380 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:28.443549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:28.452414 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:28.453795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:28.454952 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e7ca7983-7a5c-42bd-86f5-02a549f5d079 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.155997 Sep 24 19:51:28.455515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 461/881] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:28 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:29.206708 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:29.208940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:29.215465 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:29.215953 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:29.216892 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:29.217616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:29.218077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:29.218506 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:29.249135 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-7b1558c8-4fb6-4d4c-8852-8b28d299fe24 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046366 Sep 24 19:51:29.249854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 421/882] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:29 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:29.479847 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:29.480467 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:29.486920 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:29.487413 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:29.487889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:29.488595 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:29.489060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:29.489492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:29.618303 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:29.627349 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:29.628761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:29.629932 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-cc6f829e-c520-46dc-9c59-97cdda112f89 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.154130 Sep 24 19:51:29.630492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 462/883] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:29 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:30.106234 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbf99cd7-8fc1-4cab-aebd-9fefece6c909", "device": "/dev/sdb"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:30.109316 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:30.115347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:30.115877 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:30.116315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:30.117008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:30.117463 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:30.117884 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:30.261918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:30.264298 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:30.270565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:30.271059 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:30.271565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:30.272259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:30.272740 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:30.273250 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:30.305456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c64c06a6-e26f-4338-81e8-bf88ac002dce tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047546 Sep 24 19:51:30.306243 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 463/884] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:30 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:51:30.363941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:30.385300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-0716db4a-f10b-4f3e-ac24-80850c4faed7 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "POST /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282842 Sep 24 19:51:30.385879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 422/885] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:51:30 2022] POST /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:30.656123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:30.656739 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:30.663259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:30.663782 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:30.664225 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:30.664929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:30.665390 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:30.665820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:30.805320 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:30.815177 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:30.816797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:30.818353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e8b11bae-483b-441e-86b1-f9964320df6b tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.166676 Sep 24 19:51:30.819402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 464/886] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:30 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:30.846422 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-ec72dadd-c440-4e55-a483-37226e29315d req-b0700254-ca8f-4928-a613-a279ebb32411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c550fec-675d-43cd-9f53-9d9e3393ce01", "name": "network-vif-plugged", "status": "completed", "tag": "d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:30.856796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ec72dadd-c440-4e55-a483-37226e29315d req-b0700254-ca8f-4928-a613-a279ebb32411 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:30.857312 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ec72dadd-c440-4e55-a483-37226e29315d req-b0700254-ca8f-4928-a613-a279ebb32411 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:30.857875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-ec72dadd-c440-4e55-a483-37226e29315d req-b0700254-ca8f-4928-a613-a279ebb32411 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:30.869289 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-ec72dadd-c440-4e55-a483-37226e29315d req-b0700254-ca8f-4928-a613-a279ebb32411 service nova] Creating event network-vif-plugged:d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26 for instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 on hv-cinder-85919 Sep 24 19:51:30.874850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-ec72dadd-c440-4e55-a483-37226e29315d req-b0700254-ca8f-4928-a613-a279ebb32411 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Sep 24 19:51:30.875478 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 423/887] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:31.318444 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:31.320793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:31.326905 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:31.327390 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:31.327893 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:31.328594 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:31.329083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:31.329514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:31.361074 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-343b0f4b-13c3-42cf-a111-526aca4e4f33 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Sep 24 19:51:31.361637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 465/888] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:31 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:31.847347 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:31.848180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:31.851573 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=64 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:31.855170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:31.855698 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:31.856317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:31.857167 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:31.857721 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:31.858208 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:31.992294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:32.001039 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:32.002501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:32.003682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8f554b5f-c74a-482c-ac49-487a58d768fb tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.161189 Sep 24 19:51:32.004237 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 424/889] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:31 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:32.374140 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:32.376308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:32.382704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:32.383190 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:32.383657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:32.384359 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:32.384816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:32.385239 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:32.417045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a84e006a-75a7-4b8c-a263-856b17de57fe tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047365 Sep 24 19:51:32.417587 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 466/890] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:32 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:33.029513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:33.030132 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:33.036870 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:33.037382 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:33.037806 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:33.038512 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:33.038971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:33.039401 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:33.177964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:33.186676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:33.188156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:33.189308 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4fe773bf-e124-4b4f-9628-d9c7a201fb10 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1728 microversion: 2.20 time: 0.164243 Sep 24 19:51:33.189864 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 425/891] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:33 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:33.429851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:33.432124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:33.439680 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:33.440216 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:33.440667 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:33.441435 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:33.441899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:33.442332 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:33.475259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-91db2f3e-e80e-46b2-9b52-89666ccb2cc0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049521 Sep 24 19:51:33.475852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 467/892] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:33 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:34.080506 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:34.082744 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:34.089337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.089830 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.090272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.090979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.092049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.092486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.123218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8fe1d4dc-5522-43c3-a8a1-f69c826eb10e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046581 Sep 24 19:51:34.123825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 426/893] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:34 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:34.134678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:34.135183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:34.141842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.142335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.142780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.143542 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.144011 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.144443 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.174597 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-11feb4fc-22f7-4e82-b3a5-7fec96ee42be tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/32e70543-c1c2-4ce5-aa25-61f9d40fd850" status: 200 len: 194 microversion: 2.1 time: 0.043855 Sep 24 19:51:34.175208 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 468/894] 10.222.0.55 () {58 vars in 1413 bytes} [Sat Sep 24 19:51:34 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/32e70543-c1c2-4ce5-aa25-61f9d40fd850 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:34.214904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:34.215624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:34.223395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.223921 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.224544 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.225244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.225717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.226146 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.372262 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:34.387225 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:34.389677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:34.390941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c2498115-9e65-4c40-afc9-4f05bd80f782 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1715 microversion: 2.20 time: 0.180600 Sep 24 19:51:34.391542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 427/895] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:51:34 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1715 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:51:34.489790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:34.492035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:34.498499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.498994 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.499461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.500159 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:34.500624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:34.501056 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:34.534690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2545e83b-3c94-4a5f-82a8-586934bf92e1 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051176 Sep 24 19:51:34.535271 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 469/896] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:34 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:35.547200 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:35.549551 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:35.552467 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efa9f150-2f4e-41e4-9194-2c437d504bee"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:35.554927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:35.556426 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.556923 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.557364 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.558066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.558707 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.559201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.561696 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.562188 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.562629 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.563359 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.563841 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.564273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.590263 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3ccb4a20-7021-47c7-8ab6-2d92f5909d1f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047631 Sep 24 19:51:35.590824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 428/897] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:35 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:51:35.654693 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:35.655201 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:35.661248 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.661734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.662171 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.662866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.663330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.663784 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.690078 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:51:35.796616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d3f405a9-ab51-494b-8de1-44b614994d25 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 204 len: 0 microversion: 2.1 time: 0.146116 Sep 24 19:51:35.797346 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 429/898] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:51:35 2022] DELETE /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 19:51:35.806742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:35.807550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:35.814651 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.815136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.815635 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.816331 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:35.816788 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:35.817210 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:35.860249 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3ffa50e5-f82e-45ff-93bb-8c5d0a9ab540 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "POST /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311650 Sep 24 19:51:35.860889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 470/899] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:51:35 2022] POST /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:51:35.957120 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:35.965052 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c63c6b33-69c3-4efa-8c61-15ae17ca5570 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1682 microversion: 2.1 time: 0.163200 Sep 24 19:51:35.965537 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 430/900] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:35 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:36.989840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:36.990814 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:37.010164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:37.010707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:37.011163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:37.011927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:37.012398 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:37.012832 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:37.017960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:37.151301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:37.159803 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-45899f52-ffad-4058-b489-677e3fea8c51 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1682 microversion: 2.1 time: 0.174835 Sep 24 19:51:37.160360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 471/901] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:36 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:51:38.183279 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:38.183928 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:38.190572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:38.191075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:38.191554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:38.192257 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:38.192738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:38.193148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:38.447411 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be2ad8e7eefe447ca1374d49696b1318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808b55bc616349cfb31ee041ce69c976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:38.456125 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-946dfd85-b429-4de0-8ae9-35d6049b0ca5 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 200 len: 1682 microversion: 2.1 time: 0.276613 Sep 24 19:51:38.456716 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 431/902] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:38 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:51:38.754101 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-b3f7bfd9-57a3-4acd-9429-1b887867fdec req-1ca75c6d-3e57-484d-b2ca-30cf2871c3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b9ca45e-085c-4ccf-a6b5-36960297291b", "name": "network-vif-deleted", "tag": "5d8bf27f-a758-4118-ae21-8e85de0af835"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:51:38.770301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b3f7bfd9-57a3-4acd-9429-1b887867fdec req-1ca75c6d-3e57-484d-b2ca-30cf2871c3a4 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:38.770787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b3f7bfd9-57a3-4acd-9429-1b887867fdec req-1ca75c6d-3e57-484d-b2ca-30cf2871c3a4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:38.771366 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-b3f7bfd9-57a3-4acd-9429-1b887867fdec req-1ca75c6d-3e57-484d-b2ca-30cf2871c3a4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:38.785053 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-b3f7bfd9-57a3-4acd-9429-1b887867fdec req-1ca75c6d-3e57-484d-b2ca-30cf2871c3a4 service nova] Creating event network-vif-deleted:5d8bf27f-a758-4118-ae21-8e85de0af835 for instance 9b9ca45e-085c-4ccf-a6b5-36960297291b on hv-cinder-85919 Sep 24 19:51:38.791002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-b3f7bfd9-57a3-4acd-9429-1b887867fdec req-1ca75c6d-3e57-484d-b2ca-30cf2871c3a4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124683 Sep 24 19:51:38.795203 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 472/903] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:39.486017 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:39.486652 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:39.493893 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:39.494624 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:39.495247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:39.496147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:39.496777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:39.497246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:39.512524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b HTTP/1.1 Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:51:39.514822 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:39.516570 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '9b9ca45e-085c-4ccf-a6b5-36960297291b'} Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:39.517676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:39.518997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:39.520349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:39.520349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-763cd396-a638-4421-9e9d-9ea146e7a7f0 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 404 len: 111 microversion: 2.1 time: 0.038739 Sep 24 19:51:39.520349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 432/904] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:39 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:39.526663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e22692a3-d79a-4946-ab45-19cab634e187 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '.version_select at 0x7f5417a22e50>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:39.548819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e22692a3-d79a-4946-ab45-19cab634e187 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023720443" status: 202 len: 0 microversion: 2.1 time: 0.026782 Sep 24 19:51:39.549707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 473/905] 10.222.0.55 () {58 vars in 1221 bytes} [Sat Sep 24 19:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023720443 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:51:41.598449 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:41.598960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:41.606034 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:41.606531 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:41.607233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:41.608056 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:41.608528 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:41.608967 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:41.622491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: DELETE /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b HTTP/1.1 Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:51:41.624504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.626241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '9b9ca45e-085c-4ccf-a6b5-36960297291b'} Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:41.627091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.628314 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.629482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:41.629482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bb750266-7d93-4fb0-9303-85fa2ce7b920 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 404 len: 111 microversion: 2.1 time: 0.031252 Sep 24 19:51:41.629482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 433/906] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:51:41 2022] DELETE /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:41.635256 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:41.636036 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 9b9ca45e-085c-4ccf-a6b5-36960297291b] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:41.648678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:41.649170 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:41.649612 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:41.650316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:41.650775 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:41.651202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:41.665931 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b HTTP/1.1 Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:51:41.667686 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.669613 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '9b9ca45e-085c-4ccf-a6b5-36960297291b'} Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:41.670588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. Sep 24 19:51:41.672080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:41.673783 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 9b9ca45e-085c-4ccf-a6b5-36960297291b could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:41.673783 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-622bcf85-6065-4c77-9d2b-fac545cd0798 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b" status: 404 len: 111 microversion: 2.1 time: 0.038561 Sep 24 19:51:41.673783 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 474/907] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:41 2022] GET /compute/v2.1/servers/9b9ca45e-085c-4ccf-a6b5-36960297291b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:42.818894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:42.819399 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:42.826470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.827220 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.827730 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.828612 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.829121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.829603 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.847684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: DELETE /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 HTTP/1.1 Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:51:42.849372 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.851238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': 'ee50330a-a26e-440d-9b04-4eddbbb417f9'} Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:42.852299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.854107 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.855883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:42.855883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-daee0a06-9c3e-4623-b373-6236099d9e9f tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 404 len: 111 microversion: 2.1 time: 0.035937 Sep 24 19:51:42.855883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 434/908] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:51:42 2022] DELETE /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:42.861637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:42.862291 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: ee50330a-a26e-440d-9b04-4eddbbb417f9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:42.868852 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.869345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.869795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.870491 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.870958 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.871392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.884707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 HTTP/1.1 Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:51:42.886259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.888360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': 'ee50330a-a26e-440d-9b04-4eddbbb417f9'} Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:42.889342 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. Sep 24 19:51:42.891001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.892633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance ee50330a-a26e-440d-9b04-4eddbbb417f9 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:42.892633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-42627c6a-0a0b-4c1a-9804-2afac2276505 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9" status: 404 len: 111 microversion: 2.1 time: 0.030893 Sep 24 19:51:42.892633 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 475/909] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:42 2022] GET /compute/v2.1/servers/ee50330a-a26e-440d-9b04-4eddbbb417f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:42.896215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:42.896739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:42.903099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.904250 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.904704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.905408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.905875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.906312 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.920513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: DELETE /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef HTTP/1.1 Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:51:42.922086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.923739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '3ff9117a-11ce-4612-9153-8356567961ef'} Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:42.924625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.926162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.927725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:42.927725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1c360e61-c84b-4c1b-91f6-1cf46a1a5037 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 404 len: 111 microversion: 2.1 time: 0.031126 Sep 24 19:51:42.927725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 435/910] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:51:42 2022] DELETE /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:42.932466 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:42.933082 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 3ff9117a-11ce-4612-9153-8356567961ef] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:42.939146 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.939665 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.940106 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.940794 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:42.941253 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:42.941683 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:42.956912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef HTTP/1.1 Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:51:42.958430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.960042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '3ff9117a-11ce-4612-9153-8356567961ef'} Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:42.960940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. Sep 24 19:51:42.962438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:42.964058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 3ff9117a-11ce-4612-9153-8356567961ef could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:42.964058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5ed0800f-6ec7-463f-bd8f-bae147100daf tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef" status: 404 len: 111 microversion: 2.1 time: 0.031513 Sep 24 19:51:42.964058 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 476/911] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:42 2022] GET /compute/v2.1/servers/3ff9117a-11ce-4612-9153-8356567961ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:46.221911 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:46.222450 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:46.230284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:46.230812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:46.231309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:46.232571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:46.233035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:46.233468 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:46.247100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: DELETE /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 HTTP/1.1 Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:51:46.249344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.250840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '80229451-4d17-4bee-9b50-a0cc56402c62'} Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:46.251617 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.253075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.254650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:46.254650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c4f20251-359e-4e59-85f1-531018872483 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "DELETE /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 404 len: 111 microversion: 2.1 time: 0.032806 Sep 24 19:51:46.254650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 436/912] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:51:46 2022] DELETE /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:51:46.259494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:46.260114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] [instance: 80229451-4d17-4bee-9b50-a0cc56402c62] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:46.267105 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:46.267647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:46.268087 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:46.268803 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:46.269264 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:46.269697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:46.283393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] HTTP exception thrown: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Request method failure captured: Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 HTTP/1.1 Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL146jYpohN52gXWnji34ifSxPcnIjcqhBZ0MySmrfW32pQZkZfDaXTIcmxtV-H4IYc6XGgur8kg-s-UxwpgQ0pbizz8Gh5v_7dsP7JYGwzsRIi6l5ehaUODskpMLO0NQ83-QhOhIRcqeWYJRBInTvt8151Yx1jon6KJqRjmMK4CZ0KY Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:51:46.284960 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_808b55bc616349cfb31ee041ce69c976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/808b55bc616349cfb31ee041ce69c976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 808b55bc616349cfb31ee041ce69c976 Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1511632923 Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: be2ad8e7eefe447ca1374d49696b1318 Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeNegativeTest-1511632923-project Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.286556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '80229451-4d17-4bee-9b50-a0cc56402c62'} Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:51:46.287404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. Sep 24 19:51:46.288903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:51:46.290211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] Returning 404 to user: Instance 80229451-4d17-4bee-9b50-a0cc56402c62 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:51:46.290211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-38a22f7a-9eec-4e20-a821-f5ae7d6e4681 tempest-AttachVolumeNegativeTest-1511632923 tempest-AttachVolumeNegativeTest-1511632923-project] 10.222.0.55 "GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62" status: 404 len: 111 microversion: 2.1 time: 0.030766 Sep 24 19:51:46.290211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 477/913] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:46 2022] GET /compute/v2.1/servers/80229451-4d17-4bee-9b50-a0cc56402c62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:51:51.930670 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:51.933379 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:51.940547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:51.941186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:51.941743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:51.942520 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:51.943079 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:51.943627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:51.971982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e4bb36d9-d68d-4780-adcd-407afb2ef0b1 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417b2f670>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:51.977832 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d5135ae6-ea5c-411b-86b3-5411e848cdff tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051274 Sep 24 19:51:51.978410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 437/914] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:51 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:52.021470 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e4bb36d9-d68d-4780-adcd-407afb2ef0b1 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/84362a47-ebc0-4e20-908c-4ae83352f8b0" status: 200 len: 351 microversion: 2.1 time: 0.053443 Sep 24 19:51:52.022034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 478/915] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:51:51 2022] GET /compute/v2.1/os-volumes/84362a47-ebc0-4e20-908c-4ae83352f8b0 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:51:52.118859 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:52.119460 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:52.125568 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:52.126072 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:52.126519 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:52.127704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:52.128172 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:52.128614 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:52.171507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-95b40e9b-53d7-4344-ba8d-3769b57137cd tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/32e70543-c1c2-4ce5-aa25-61f9d40fd850" status: 200 len: 194 microversion: 2.1 time: 0.056673 Sep 24 19:51:52.172100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 438/916] 10.222.0.55 () {58 vars in 1413 bytes} [Sat Sep 24 19:51:52 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/32e70543-c1c2-4ce5-aa25-61f9d40fd850 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:52.182698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:52.183378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:52.191558 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:52.192139 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:52.192653 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:52.193430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:52.193979 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:52.194598 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:52.281588 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lazy-loading 'services' on Instance uuid 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:51:52.365769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-404d4303-2f62-4a59-abb3-c29774d93ffa tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/32e70543-c1c2-4ce5-aa25-61f9d40fd850" status: 202 len: 0 microversion: 2.1 time: 0.186543 Sep 24 19:51:52.366362 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 479/917] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:51:52 2022] DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/32e70543-c1c2-4ce5-aa25-61f9d40fd850 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 19:51:55.518846 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c90d8289-ff3c-44df-8747-e2778be9feb3 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417a870d0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:55.569398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c90d8289-ff3c-44df-8747-e2778be9feb3 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/a337f292-bf5d-4875-bf68-c473b232eb18" status: 200 len: 350 microversion: 2.1 time: 0.054308 Sep 24 19:51:55.569973 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 439/918] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:51:55 2022] GET /compute/v2.1/os-volumes/a337f292-bf5d-4875-bf68-c473b232eb18 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:56.685433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:56.686086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:56.692259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:56.692749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:56.693182 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:56.693877 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:56.694335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:56.694763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:56.723114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-73913b09-c409-44ff-b6f6-88607b7aac40 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/efa9f150-2f4e-41e4-9194-2c437d504bee" status: 200 len: 194 microversion: 2.1 time: 0.043299 Sep 24 19:51:56.723731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 480/919] 10.222.0.55 () {58 vars in 1413 bytes} [Sat Sep 24 19:51:56 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/efa9f150-2f4e-41e4-9194-2c437d504bee => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:56.736015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:56.736577 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:56.743452 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:56.743942 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:56.744388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:56.745116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:56.745579 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:56.746012 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:56.826247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lazy-loading 'services' on Instance uuid 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:51:56.900105 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f0e59773-7890-4c95-80b6-4d00a8f1e960 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/efa9f150-2f4e-41e4-9194-2c437d504bee" status: 202 len: 0 microversion: 2.1 time: 0.168963 Sep 24 19:51:56.900682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 440/920] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:51:56 2022] DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments/efa9f150-2f4e-41e4-9194-2c437d504bee => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:51:56.983949 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-424db8b8-b428-4614-9a9b-dd477aaad1ab tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417c17b80>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.031891 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-424db8b8-b428-4614-9a9b-dd477aaad1ab tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/fd409951-749b-4965-a2c4-280001e5382b" status: 200 len: 351 microversion: 2.1 time: 0.052532 Sep 24 19:51:57.032537 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 481/921] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:51:56 2022] GET /compute/v2.1/os-volumes/fd409951-749b-4965-a2c4-280001e5382b => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:57.047160 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-09f676fc-3f73-455c-a317-9cba88071e85 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417afa160>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.135304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-09f676fc-3f73-455c-a317-9cba88071e85 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093186 Sep 24 19:51:57.135865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 441/922] 10.222.0.55 () {58 vars in 1134 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:57.151485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7583a3a2-18c7-470b-9591-98b9b9159565 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417c178b0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.235042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7583a3a2-18c7-470b-9591-98b9b9159565 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088108 Sep 24 19:51:57.235651 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 482/923] 10.222.0.55 () {58 vars in 1149 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:57.249245 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-bb9d0a5c-70e1-4eda-a814-436d7230069e tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417aad820>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.330964 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-bb9d0a5c-70e1-4eda-a814-436d7230069e tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085457 Sep 24 19:51:57.331653 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 442/924] 10.222.0.55 () {58 vars in 1134 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:57.345888 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-bc57c180-ef40-4b0a-86d8-6dac114ddf60 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417b84dc0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.440754 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-bc57c180-ef40-4b0a-86d8-6dac114ddf60 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.098566 Sep 24 19:51:57.441316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 483/925] 10.222.0.55 () {58 vars in 1167 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:57.455349 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-47184a33-9d95-4346-9a9c-9a9d756b1214 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417ac2ee0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.549737 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-47184a33-9d95-4346-9a9c-9a9d756b1214 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.098058 Sep 24 19:51:57.550311 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 443/926] 10.222.0.55 () {58 vars in 1170 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:57.565847 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-95c0a58a-a807-4d4c-adf2-5bcb8c801815 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417a1eca0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.649604 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-95c0a58a-a807-4d4c-adf2-5bcb8c801815 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088324 Sep 24 19:51:57.650172 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 484/927] 10.222.0.55 () {58 vars in 1155 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:51:57.663665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d30262f6-a5fb-45d8-90e1-7698e49649a2 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417c03310>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.750742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d30262f6-a5fb-45d8-90e1-7698e49649a2 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090822 Sep 24 19:51:57.751629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 444/928] 10.222.0.55 () {58 vars in 1188 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:51:57.766060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c381f6af-2f7c-45b7-be6e-123b3e2d4f65 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] Calling method '.version_select at 0x7f5417ba48b0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:57.853855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c381f6af-2f7c-45b7-be6e-123b3e2d4f65 tempest-VolumesTestJSON-496332383 tempest-VolumesTestJSON-496332383-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092786 Sep 24 19:51:57.854509 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 485/929] 10.222.0.55 () {58 vars in 1155 bytes} [Sat Sep 24 19:51:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:51:58.088098 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:58.090742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:58.097008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.097506 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.097949 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.098656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.099235 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.099574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.127114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:58.131817 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-be8042d7-6ece-4edc-a92d-fb2e32fda09e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047802 Sep 24 19:51:58.132388 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 445/930] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:58 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:51:58.253699 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:58.255909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:58.257995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:51:58.264130 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.264630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.265070 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.265787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.266247 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.266679 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.299403 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-92fdbd25-c5e3-41cf-b3e3-8e0e473f675b tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049640 Sep 24 19:51:58.300006 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 486/931] 10.222.0.55 () {58 vars in 1302 bytes} [Sat Sep 24 19:51:58 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 19:51:58.369185 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:58.369792 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:58.377653 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.378156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.378600 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.379319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.379815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.380249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.408688 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:51:58.495463 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-50fee0d0-55e0-4ddc-9218-a1747047743e tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 204 len: 0 microversion: 2.1 time: 0.129914 Sep 24 19:51:58.496328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 446/932] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:51:58 2022] DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:51:58.505325 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:58.505854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:58.512096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.512839 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.513378 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.514108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.514584 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.515020 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.534865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:58.535978 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:58.542664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.542841 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.543236 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.544781 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:58.545250 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:58.545680 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:58.630275 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lazy-loading 'services' on Instance uuid a085d2af-3858-4503-a642-448b4fc1330f {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:51:58.662402 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:58.671387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-acaff5b0-2000-4161-a64d-8680afac51a2 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1673 microversion: 2.1 time: 0.169956 Sep 24 19:51:58.672093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 487/933] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:58 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:51:58.704140 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-41db81ac-a400-4b55-9244-272f9ad01caf tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f/os-volume_attachments/fbf99cd7-8fc1-4cab-aebd-9fefece6c909" status: 202 len: 0 microversion: 2.1 time: 0.174363 Sep 24 19:51:58.704730 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 447/934] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:51:58 2022] DELETE /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f/os-volume_attachments/fbf99cd7-8fc1-4cab-aebd-9fefece6c909 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 19:51:59.694270 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:51:59.694896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:51:59.701853 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:59.702350 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:59.702798 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:59.703534 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:51:59.704008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:51:59.704445 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:51:59.836773 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:51:59.844741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4105592b-a1bf-4e44-b787-6f16da8105c8 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1673 microversion: 2.1 time: 0.154367 Sep 24 19:51:59.845302 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 488/935] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:51:59 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:00.868877 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:00.869789 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:00.877011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:00.877514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:00.877975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:00.878676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:00.879141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:00.879604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:01.110039 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:01.118863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c94a959f-1e47-427b-ad04-072ef545883f tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1673 microversion: 2.1 time: 0.254305 Sep 24 19:52:01.119465 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 448/936] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:00 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:01.925923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-e4eaacb4-e99d-415d-b3cc-34034f1b6185 req-1a6542aa-228a-4310-a685-f97b900a475e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0", "name": "network-vif-deleted", "tag": "31356b09-48e8-4e8f-8d96-f589c823cfae"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:01.980890 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e4eaacb4-e99d-415d-b3cc-34034f1b6185 req-1a6542aa-228a-4310-a685-f97b900a475e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:01.982360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e4eaacb4-e99d-415d-b3cc-34034f1b6185 req-1a6542aa-228a-4310-a685-f97b900a475e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:01.986233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-e4eaacb4-e99d-415d-b3cc-34034f1b6185 req-1a6542aa-228a-4310-a685-f97b900a475e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.006688 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-e4eaacb4-e99d-415d-b3cc-34034f1b6185 req-1a6542aa-228a-4310-a685-f97b900a475e service nova] Creating event network-vif-deleted:31356b09-48e8-4e8f-8d96-f589c823cfae for instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 on hv-cinder-85919 Sep 24 19:52:02.027912 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-e4eaacb4-e99d-415d-b3cc-34034f1b6185 req-1a6542aa-228a-4310-a685-f97b900a475e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119909 Sep 24 19:52:02.029742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 489/937] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:02.082215 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:02.084037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:02.094438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:02.107657 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:02.108891 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:02.110673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.112431 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:02.114406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:02.115468 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.144257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:02.145243 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:02.163045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:02.165064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:02.165837 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.168538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:02.171715 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:02.172384 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.179128 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:52:02.229165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:02.229874 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:02.230504 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.231238 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lazy-loading 'fault' on Instance uuid 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:52:02.282465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:02.292444 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7412935a-743e-4dd7-859c-9e2777dcdf03 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1326 microversion: 2.1 time: 0.152456 Sep 24 19:52:02.293214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 490/938] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:02 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:02.392136 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c111d4a8-c0ac-4493-94b3-510e51deb593 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 204 len: 0 microversion: 2.1 time: 0.316368 Sep 24 19:52:02.395521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 449/939] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:52:02 2022] DELETE /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:52:02.407527 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:02.409331 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:02.421181 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:02.422080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:02.422792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.423840 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:02.424568 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:02.425167 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:02.588819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:02.597460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9883b44b-4238-4a67-b20f-91f87ad89219 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1514 microversion: 2.1 time: 0.198009 Sep 24 19:52:02.598279 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 491/940] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:02 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:52:03.318974 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:03.319882 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:03.327302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:03.327970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:03.328523 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:03.329514 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:03.330089 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:03.330665 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:03.365972 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:03.366465 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:03.366910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:03.367365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lazy-loading 'fault' on Instance uuid 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:52:03.414169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:03.423650 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-909d58e9-be99-4e5e-a950-1c030f7b025d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1326 microversion: 2.1 time: 0.109096 Sep 24 19:52:03.424241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 450/941] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:03 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:03.622273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:03.623023 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:03.630392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:03.630899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:03.631343 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:03.632086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:03.632552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:03.632985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:03.769147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:03.777446 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-de9d935e-82fd-46c9-b5f6-03d6ed387fd2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1514 microversion: 2.1 time: 0.159176 Sep 24 19:52:03.779204 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 492/942] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:03 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:04.448678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:04.449406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:04.456937 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:04.457427 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:04.457865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:04.459097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:04.459606 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:04.460036 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:04.495330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:04.495865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:04.496305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:04.496942 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lazy-loading 'fault' on Instance uuid 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:52:04.569791 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444719e34bf2457b9a58e182ef7fbd79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977038321e5a41e8ab137fede4d118d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:04.577213 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-39c43ebe-aded-4c00-93fe-1e7a8d1f492a tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 200 len: 1326 microversion: 2.1 time: 0.133268 Sep 24 19:52:04.577805 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 451/943] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:04 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:04.802615 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:04.803515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:04.810244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:04.811293 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:04.811782 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:04.812507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:04.812971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:04.813404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:04.885982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:04.895548 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e2c781ca-fd1c-4d3c-abe2-6cedc54c7d71 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 200 len: 1472 microversion: 2.1 time: 0.096793 Sep 24 19:52:04.896769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 493/944] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:04 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:04.938171 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-aec81715-52e2-4212-8330-85776807fa48 req-6e6a7969-fee5-41a4-bb45-fdebbb6d7c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a085d2af-3858-4503-a642-448b4fc1330f", "name": "network-vif-deleted", "tag": "e8ccdf98-f282-4b7f-a739-d913fe993d4b"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:04.950274 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-aec81715-52e2-4212-8330-85776807fa48 req-6e6a7969-fee5-41a4-bb45-fdebbb6d7c99 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:04.951042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-aec81715-52e2-4212-8330-85776807fa48 req-6e6a7969-fee5-41a4-bb45-fdebbb6d7c99 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:04.951664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-aec81715-52e2-4212-8330-85776807fa48 req-6e6a7969-fee5-41a4-bb45-fdebbb6d7c99 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:04.967046 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-aec81715-52e2-4212-8330-85776807fa48 req-6e6a7969-fee5-41a4-bb45-fdebbb6d7c99 service nova] Creating event network-vif-deleted:e8ccdf98-f282-4b7f-a739-d913fe993d4b for instance a085d2af-3858-4503-a642-448b4fc1330f on hv-cinder-85919 Sep 24 19:52:04.972948 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-aec81715-52e2-4212-8330-85776807fa48 req-6e6a7969-fee5-41a4-bb45-fdebbb6d7c99 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039318 Sep 24 19:52:04.973815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 452/945] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:52:05.601263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:05.601882 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:05.608454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:05.608953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:05.609396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:05.610117 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:05.610582 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:05.611017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:05.624770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] HTTP exception thrown: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Request method failure captured: Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 HTTP/1.1 Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL148O1nVi5Nkg3Sz_Gk5i6C7E0I7-8AlPmjxAzirtElASsxdrl65tC0waW0XQfSAfzOMMcPsUjf_5uedqmBzPWQEnsuS4JDCatYozIlEOV3REevG91xt0cPYzcXtSEYZpL8EqPyR9lJcysmRw-KfaPqhq3i9v_jlVi8JWn9Sq30xAJ8 Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:05.626481 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_977038321e5a41e8ab137fede4d118d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 444719e34bf2457b9a58e182ef7fbd79 Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:05.628035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0'} Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:05.628886 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:05.630158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.631472 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Returning 404 to user: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:05.631472 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-17512580-c1ad-4e9b-94fc-5031a2d66d4d tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 404 len: 111 microversion: 2.1 time: 0.030782 Sep 24 19:52:05.631472 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 494/946] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:05 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:05.639016 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-11b8eb44-d90c-4a74-9541-c374f04a0508 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '.version_select at 0x7f5417ae91f0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:05.660502 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-11b8eb44-d90c-4a74-9541-c374f04a0508 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478990488" status: 202 len: 0 microversion: 2.1 time: 0.027162 Sep 24 19:52:05.661095 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 453/947] 10.222.0.55 () {58 vars in 1221 bytes} [Sat Sep 24 19:52:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1478990488 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:52:05.921672 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:05.922322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: a085d2af-3858-4503-a642-448b4fc1330f] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:05.929843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:05.930358 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:05.930818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:05.931609 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:05.932127 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:05.932697 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:05.950444 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] HTTP exception thrown: Instance a085d2af-3858-4503-a642-448b4fc1330f could not be found. Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Request method failure captured: Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f HTTP/1.1 Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL1-kHKY5PcHWjCtLyD_85uKYMYlbp35aX4sC024Okr21gfCmdfvlTfF_ZSfOxTASnUp50lRWz40W0thBhgngC5vXignmd0B50L2K1UDKQXi-jY93-nHr8XUR3Y1VpwaG_sYX5QQIQCnYoOUwDSbnfO4emqFEakff4oADzV0vjBsJ_EQ Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: bd71c6be7e9d4741b129fbc0e6fafad4 Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesSnapshotTestJSON-358269180 Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:05.952780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesSnapshotTestJSON-358269180 Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: bd71c6be7e9d4741b129fbc0e6fafad4 Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-358269180 Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesSnapshotTestJSON-358269180-project Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 875e4edde2834c8d9fd40cb219c4d2fd Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesSnapshotTestJSON-358269180-project Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance a085d2af-3858-4503-a642-448b4fc1330f could not be found. Sep 24 19:52:05.954407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': 'a085d2af-3858-4503-a642-448b4fc1330f'} Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a085d2af-3858-4503-a642-448b4fc1330f could not be found. Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:05.955372 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a085d2af-3858-4503-a642-448b4fc1330f could not be found. Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a085d2af-3858-4503-a642-448b4fc1330f could not be found. Sep 24 19:52:05.956871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:05.958850 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Returning 404 to user: Instance a085d2af-3858-4503-a642-448b4fc1330f could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:05.959745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0791e7a6-00bb-4fb3-975b-5c1b1c0271f8 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f" status: 404 len: 111 microversion: 2.1 time: 0.043591 Sep 24 19:52:05.960315 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 495/948] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:05 2022] GET /compute/v2.1/servers/a085d2af-3858-4503-a642-448b4fc1330f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:52:16.956975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:16.957722 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:16.961720 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-158575864", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452", "networks": [{"uuid": "ad49e007-fa2a-411f-8eef-41c1c78b2d91"}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:17.073992 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:17.075487 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:17.078501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=21 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:17.079244 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:17.085737 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:17.086340 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:17.086923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:17.087816 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:17.088368 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:17.088898 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:17.106614 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] HTTP exception thrown: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Request method failure captured: Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 HTTP/1.1 Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL148O1nVi5Nkg3Sz_Gk5i6C7E0I7-8AlPmjxAzirtElASsxdrl65tC0waW0XQfSAfzOMMcPsUjf_5uedqmBzPWQEnsuS4JDCatYozIlEOV3REevG91xt0cPYzcXtSEYZpL8EqPyR9lJcysmRw-KfaPqhq3i9v_jlVi8JWn9Sq30xAJ8 Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:17.108492 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_977038321e5a41e8ab137fede4d118d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 444719e34bf2457b9a58e182ef7fbd79 Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.110089 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0'} Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:17.111002 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.112254 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.113596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Returning 404 to user: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:17.113596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b2d646d4-871b-4d6c-8336-85d48e50890c tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 404 len: 111 microversion: 2.1 time: 0.046191 Sep 24 19:52:17.113596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 496/949] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:52:17 2022] DELETE /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:17.119624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:17.120570 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:17.127865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:17.128527 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:17.129150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:17.129758 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:17.130217 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:17.130646 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:17.150277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] HTTP exception thrown: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Request method failure captured: Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 HTTP/1.1 Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL148O1nVi5Nkg3Sz_Gk5i6C7E0I7-8AlPmjxAzirtElASsxdrl65tC0waW0XQfSAfzOMMcPsUjf_5uedqmBzPWQEnsuS4JDCatYozIlEOV3REevG91xt0cPYzcXtSEYZpL8EqPyR9lJcysmRw-KfaPqhq3i9v_jlVi8JWn9Sq30xAJ8 Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:17.156820 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_977038321e5a41e8ab137fede4d118d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 444719e34bf2457b9a58e182ef7fbd79 Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.159647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0'} Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:17.160985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. Sep 24 19:52:17.163132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:17.165375 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Returning 404 to user: Instance 9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:17.165375 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-c07b3e53-cec5-4cf4-8d05-f2e292767389 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0" status: 404 len: 111 microversion: 2.1 time: 0.043310 Sep 24 19:52:17.165375 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 497/950] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:17 2022] GET /compute/v2.1/servers/9aeec5c9-ce6b-4ef2-b0fa-0dc0865efaf0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:52:17.187887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] validate_networks() for [('ad49e007-fa2a-411f-8eef-41c1c78b2d91', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:52:17.557258 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:52:17.557689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:52:17.558171 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:52:17.558585 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:52:17.559924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:52:17.568815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:17.569304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:17.569786 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:17.570486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:17.571148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:17.571633 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:17.589115 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Getting quotas for project bd71c6be7e9d4741b129fbc0e6fafad4. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:52:17.593406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Getting quotas for user 875e4edde2834c8d9fd40cb219c4d2fd and project bd71c6be7e9d4741b129fbc0e6fafad4. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:52:17.604695 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:52:17.607703 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:52:17.653737 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-986b70a8-e962-4d89-8a1b-139972a11e0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698114 Sep 24 19:52:17.654710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 454/951] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 19:52:17.665930 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5bed04d9-6511-42cb-8e52-db4144c9675d tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:17.666602 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5bed04d9-6511-42cb-8e52-db4144c9675d tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:17.723077 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5bed04d9-6511-42cb-8e52-db4144c9675d tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:17.731734 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5bed04d9-6511-42cb-8e52-db4144c9675d tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1218 microversion: 2.1 time: 0.069519 Sep 24 19:52:17.732571 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 498/952] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:17 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:52:18.344778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:18.345326 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:18.351634 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:18.352141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:18.352574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:18.353501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:18.354120 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:18.354763 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:18.370427 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] HTTP exception thrown: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Request method failure captured: Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: DELETE /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd HTTP/1.1 Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL148O1nVi5Nkg3Sz_Gk5i6C7E0I7-8AlPmjxAzirtElASsxdrl65tC0waW0XQfSAfzOMMcPsUjf_5uedqmBzPWQEnsuS4JDCatYozIlEOV3REevG91xt0cPYzcXtSEYZpL8EqPyR9lJcysmRw-KfaPqhq3i9v_jlVi8JWn9Sq30xAJ8 Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:18.372607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_977038321e5a41e8ab137fede4d118d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 444719e34bf2457b9a58e182ef7fbd79 Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.374243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '9c0ca8da-4101-49bb-8747-b834c6555edd'} Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:18.375062 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.376654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.379010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Returning 404 to user: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:18.379010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b3b4553a-dd27-44a0-8503-856ac66fb499 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 404 len: 111 microversion: 2.1 time: 0.033844 Sep 24 19:52:18.379010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 455/953] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:52:18 2022] DELETE /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:52:18.383327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:18.383965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] [instance: 9c0ca8da-4101-49bb-8747-b834c6555edd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:18.393440 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:18.393945 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:18.394392 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:18.395103 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:18.395626 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:18.396077 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:18.410527 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] HTTP exception thrown: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Request method failure captured: Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd HTTP/1.1 Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL148O1nVi5Nkg3Sz_Gk5i6C7E0I7-8AlPmjxAzirtElASsxdrl65tC0waW0XQfSAfzOMMcPsUjf_5uedqmBzPWQEnsuS4JDCatYozIlEOV3REevG91xt0cPYzcXtSEYZpL8EqPyR9lJcysmRw-KfaPqhq3i9v_jlVi8JWn9Sq30xAJ8 Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:18.412060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_977038321e5a41e8ab137fede4d118d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/977038321e5a41e8ab137fede4d118d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 977038321e5a41e8ab137fede4d118d7 Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1007996782 Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 444719e34bf2457b9a58e182ef7fbd79 Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeTestJSON-1007996782-project Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.413634 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '9c0ca8da-4101-49bb-8747-b834c6555edd'} Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:18.414507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. Sep 24 19:52:18.417214 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:18.420321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] Returning 404 to user: Instance 9c0ca8da-4101-49bb-8747-b834c6555edd could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:18.420321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d853b4c9-1890-4971-8918-53aecc9d5155 tempest-AttachVolumeTestJSON-1007996782 tempest-AttachVolumeTestJSON-1007996782-project] 10.222.0.55 "GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd" status: 404 len: 111 microversion: 2.1 time: 0.034547 Sep 24 19:52:18.420321 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 499/954] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:18 2022] GET /compute/v2.1/servers/9c0ca8da-4101-49bb-8747-b834c6555edd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:18.756047 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:18.757059 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:18.763640 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:18.764133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:18.764572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:18.765284 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:18.765742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:18.766162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:18.904824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:18.915180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-45e5d938-429f-43ee-a4bc-8344194abc0c tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1270 microversion: 2.1 time: 0.162909 Sep 24 19:52:18.918578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 456/955] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:18 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:19.941460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:19.942088 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:19.953915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:19.954721 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:19.955165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:19.955915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:19.956544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:19.957135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:20.514265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:20.519930 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-90c04cac-6c01-4c86-8196-e65b189debed req-ead4d923-6b42-4ba5-83c1-9041105ca485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148a9561-c865-4739-8da8-f60a315a0092", "tag": "f1d85fae-e71e-48c3-9caf-612bf921e609"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:20.530209 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-25cb72aa-37c6-4f51-977f-cb486e239adb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1318 microversion: 2.1 time: 0.593411 Sep 24 19:52:20.531658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 500/956] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:19 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:52:20.549669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-90c04cac-6c01-4c86-8196-e65b189debed req-ead4d923-6b42-4ba5-83c1-9041105ca485 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:20.550365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-90c04cac-6c01-4c86-8196-e65b189debed req-ead4d923-6b42-4ba5-83c1-9041105ca485 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:20.550915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-90c04cac-6c01-4c86-8196-e65b189debed req-ead4d923-6b42-4ba5-83c1-9041105ca485 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:20.579090 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-90c04cac-6c01-4c86-8196-e65b189debed req-ead4d923-6b42-4ba5-83c1-9041105ca485 service nova] Creating event network-changed:f1d85fae-e71e-48c3-9caf-612bf921e609 for instance 148a9561-c865-4739-8da8-f60a315a0092 on hv-cinder-85919 Sep 24 19:52:20.586568 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-90c04cac-6c01-4c86-8196-e65b189debed req-ead4d923-6b42-4ba5-83c1-9041105ca485 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077382 Sep 24 19:52:20.587838 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 457/957] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:52:21.555020 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:21.556067 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:21.570903 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:21.571596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:21.572307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:21.573638 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:21.574462 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:21.575387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:21.879522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:21.891255 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-881bb4bc-9709-4bf7-a633-2772d227c824 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1318 microversion: 2.1 time: 0.340061 Sep 24 19:52:21.903454 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 501/958] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:21 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:22.555287 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:22.560327 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:22.594652 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.595387 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.596234 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:22.597572 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.598192 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.598825 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:22.633184 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d045c0e5-579d-4bf3-8f12-9342c1b2aec6 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.084602 Sep 24 19:52:22.634298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 458/959] 10.222.0.55 () {60 vars in 1343 bytes} [Sat Sep 24 19:52:22 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:22.708010 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:22.709241 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:22.716375 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.717159 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.717813 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:22.718736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.719639 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.720304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:22.748456 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:52:22.854977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9346826e-9fd7-49ad-9942-114ca101f149 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 204 len: 0 microversion: 2.20 time: 0.150403 Sep 24 19:52:22.859132 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 502/960] 10.222.0.55 () {60 vars in 1280 bytes} [Sat Sep 24 19:52:22 2022] DELETE /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 19:52:22.870384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:22.871147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:22.885454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.886111 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.886661 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:22.888216 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.888795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.889339 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:22.926849 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:22.928230 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:22.940986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.941819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.942463 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:22.943838 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:22.944638 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:22.945348 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:23.098120 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:23.107043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9a9d19d1-d58e-478d-b1c9-5e91bbaf1f4e tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1318 microversion: 2.1 time: 0.192182 Sep 24 19:52:23.107655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 503/961] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:22 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:23.208811 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:23.227249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:23.228759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:23.229940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6d25361a-c6ed-4a36-86de-ea1b7778ffa2 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.365530 Sep 24 19:52:23.243586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 459/962] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:52:22 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 19:52:24.130869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:24.132148 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:24.139965 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:24.140795 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:24.141438 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:24.142382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:24.142850 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:24.143535 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:24.257630 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:24.258255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:24.265924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:24.266455 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:24.266901 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:24.267673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:24.268150 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:24.268577 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:24.338561 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:24.368552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-76d9969f-0452-4030-be40-500af12ca1cb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1318 microversion: 2.1 time: 0.240799 Sep 24 19:52:24.369147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 504/963] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:24 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:24.447119 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:24.460187 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:24.464229 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:24.468092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-26ef6057-3235-4384-bd44-41578fe7b175 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1721 microversion: 2.20 time: 0.213397 Sep 24 19:52:24.468733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 460/964] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:52:24 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:52:24.808688 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-48f4f07f-7b80-44cd-aaf3-c8f78a50676c tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Action: 'create', calling method: .version_select at 0x7f5417b6a0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-875827488", "metadata": {"Type": "work"}}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:25.205098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-48f4f07f-7b80-44cd-aaf3-c8f78a50676c tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.665053 Sep 24 19:52:25.220489 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3593e92c-a73d-49ae-9c1c-ad09663ff4c5 tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Calling method '.version_select at 0x7f5417ac25e0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:25.223590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 505/965] 10.222.0.55 () {60 vars in 1156 bytes} [Sat Sep 24 19:52:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 684 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 19:52:25.276503 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3593e92c-a73d-49ae-9c1c-ad09663ff4c5 tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215" status: 200 len: 352 microversion: 2.1 time: 0.059899 Sep 24 19:52:25.284168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 461/966] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:25 2022] GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:25.395265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:25.395923 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:25.402014 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:25.402745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:25.402969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:25.403904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:25.404555 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:25.405038 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:25.494041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:25.494671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:25.506710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:25.507219 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:25.523207 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:25.524183 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:25.525597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:25.526353 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:25.683010 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:25.694918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5bcb6b0b-a13f-4794-9aa5-d71561afeec0 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1318 microversion: 2.1 time: 0.303470 Sep 24 19:52:25.695132 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:25.697290 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 506/967] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:25 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:25.713505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-2e0effd6-68e8-4478-bb0e-93522e213399 req-60c303b5-541a-44da-8a42-f6c27694411b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c550fec-675d-43cd-9f53-9d9e3393ce01", "name": "network-vif-deleted", "tag": "d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:25.718018 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:25.721669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6974a4c8fffd4bc2933e754770cb912e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417cf79d7d748d483e8aeb8289b75f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:25.722914 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9c6514a9-cd30-436d-a773-ce374441eb4f tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 200 len: 1653 microversion: 2.20 time: 0.232884 Sep 24 19:52:25.725112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 462/968] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:52:25 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 1653 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 19:52:25.736076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-2e0effd6-68e8-4478-bb0e-93522e213399 req-60c303b5-541a-44da-8a42-f6c27694411b service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:25.736732 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-2e0effd6-68e8-4478-bb0e-93522e213399 req-60c303b5-541a-44da-8a42-f6c27694411b service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:25.737178 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-2e0effd6-68e8-4478-bb0e-93522e213399 req-60c303b5-541a-44da-8a42-f6c27694411b service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:25.765780 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-2e0effd6-68e8-4478-bb0e-93522e213399 req-60c303b5-541a-44da-8a42-f6c27694411b service nova] Creating event network-vif-deleted:d1d9c570-a04e-4c0d-9159-eb6b9a7dbe26 for instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 on hv-cinder-85919 Sep 24 19:52:25.777478 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-2e0effd6-68e8-4478-bb0e-93522e213399 req-60c303b5-541a-44da-8a42-f6c27694411b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078447 Sep 24 19:52:25.778745 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 507/969] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:26.292655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c83fba2e-7527-4531-802f-faf704d800ea tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Calling method '.version_select at 0x7f5417b61280>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:26.352158 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-f107933b-c747-4365-85b3-5ca3027ae04a req-3d37ddaa-316a-4c2b-bb7d-18213a773830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148a9561-c865-4739-8da8-f60a315a0092", "name": "network-vif-plugged", "status": "completed", "tag": "f1d85fae-e71e-48c3-9caf-612bf921e609"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:26.359566 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c83fba2e-7527-4531-802f-faf704d800ea tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215" status: 200 len: 353 microversion: 2.1 time: 0.071768 Sep 24 19:52:26.360147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 463/970] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:26 2022] GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:26.377090 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-99885363-7fb2-49ab-a3c2-a7581daa689b tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Calling method '.version_select at 0x7f5417a87040>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:26.385062 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-f107933b-c747-4365-85b3-5ca3027ae04a req-3d37ddaa-316a-4c2b-bb7d-18213a773830 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:26.385644 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-f107933b-c747-4365-85b3-5ca3027ae04a req-3d37ddaa-316a-4c2b-bb7d-18213a773830 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:26.386183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-f107933b-c747-4365-85b3-5ca3027ae04a req-3d37ddaa-316a-4c2b-bb7d-18213a773830 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:26.399690 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-f107933b-c747-4365-85b3-5ca3027ae04a req-3d37ddaa-316a-4c2b-bb7d-18213a773830 service nova] Creating event network-vif-plugged:f1d85fae-e71e-48c3-9caf-612bf921e609 for instance 148a9561-c865-4739-8da8-f60a315a0092 on hv-cinder-85919 Sep 24 19:52:26.405996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-f107933b-c747-4365-85b3-5ca3027ae04a req-3d37ddaa-316a-4c2b-bb7d-18213a773830 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061610 Sep 24 19:52:26.407221 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 508/971] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:26.433313 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-99885363-7fb2-49ab-a3c2-a7581daa689b tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215" status: 200 len: 353 microversion: 2.1 time: 0.060435 Sep 24 19:52:26.435066 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 464/972] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:26 2022] GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:26.454792 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-45f67712-f2db-4e88-b1c8-ce8ed9e4a4fd tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Calling method '.version_select at 0x7f5417b6aee0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:26.529621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-45f67712-f2db-4e88-b1c8-ce8ed9e4a4fd tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215" status: 202 len: 0 microversion: 2.1 time: 0.080493 Sep 24 19:52:26.530286 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 509/973] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:52:26 2022] DELETE /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:52:26.538607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6fc6d9e2-9801-4fe2-a2ac-068444d82b13 tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Calling method '.version_select at 0x7f5417ae9af0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:26.597719 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6fc6d9e2-9801-4fe2-a2ac-068444d82b13 tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215" status: 200 len: 352 microversion: 2.1 time: 0.062966 Sep 24 19:52:26.598535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 465/974] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:26 2022] GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:26.719287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:26.720113 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:26.726544 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:26.727046 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:26.727522 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:26.728276 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:26.728744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:26.729194 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:26.750997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:26.751686 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:26.758283 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:26.759141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:26.760049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:26.760461 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:26.760931 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:26.761383 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:26.779152 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] HTTP exception thrown: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Request method failure captured: Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 HTTP/1.1 Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL15BwZnLWR4lBFv1yIqac9ijLPSDz3M0gzPzALA6RIN0hgVdBp-fLTmxcKySAJ9vvEZrv_wHn7B7xLMzUIAOIsyNt-rb6_YU8RwVNv5ZXLiLJ518R57slhX_gO8fFwLhu1f0WF5r580B9NzuseHOK1sF0PiHfgzBx8DJfgquD_tfuNk Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:26.780898 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 6974a4c8fffd4bc2933e754770cb912e Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:26.782521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '2c550fec-675d-43cd-9f53-9d9e3393ce01'} Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:26.783332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:26.784678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:26.785816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Returning 404 to user: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:26.785816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-88d09d96-8e03-447d-a0ed-8e1dfd275730 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 404 len: 111 microversion: 2.20 time: 0.035792 Sep 24 19:52:26.785816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 466/975] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:52:26 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:52:26.792504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4f8a6889-5dd6-4da3-a7b9-aa9b0ae9e1a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '.version_select at 0x7f5417ae9310>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:26.816648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4f8a6889-5dd6-4da3-a7b9-aa9b0ae9e1a3 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530502288" status: 204 len: 0 microversion: 2.20 time: 0.029149 Sep 24 19:52:26.817559 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 467/976] 10.222.0.55 () {60 vars in 1259 bytes} [Sat Sep 24 19:52:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530502288 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 19:52:26.889424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:26.905856 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-54cdd677-e475-42cb-8fb9-b1bf38825a57 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1318 microversion: 2.1 time: 0.191088 Sep 24 19:52:26.906464 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 510/977] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:26 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:27.610212 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:27.610904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=6 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:27.615184 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b8898316-edc1-4373-bdc8-f26ff41d016e tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Calling method '.version_select at 0x7f5417ab7b80>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:27.654554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-b8898316-edc1-4373-bdc8-f26ff41d016e tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] HTTP exception thrown: Volume 2f2862cc-d10d-4010-8778-838cd1576215 could not be found. Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b8898316-edc1-4373-bdc8-f26ff41d016e tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Request method failure captured: Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215 HTTP/1.1 Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL1_4QcFfHnmPd5dq-WyTkghE1n_0Zwh-5P6VMZMIXHmTVitAbtd398hyPiOB1_Ia0CBUC-szdrAPfPjwaZwbLT4gBudXeJQiuDLLh0kWdwbc_PCckI5LQd7TUsVT9vUZ9RHEbeIyWRDNnBpHwjkVjGgW0tcoSx3t9Uw2rqHCAcpQK_I Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 85d897789ca8446eaa73a4c4f6e7d677 Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesGetTestJSON-281129450 Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:27.657129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_85d897789ca8446eaa73a4c4f6e7d677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/85d897789ca8446eaa73a4c4f6e7d677"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/85d897789ca8446eaa73a4c4f6e7d677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/85d897789ca8446eaa73a4c4f6e7d677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesGetTestJSON-281129450 Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 85d897789ca8446eaa73a4c4f6e7d677 Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesGetTestJSON-281129450 Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesGetTestJSON-281129450-project Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: e871e64713dc46b7b09d1d7832dd2e83 Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesGetTestJSON-281129450-project Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Volume 2f2862cc-d10d-4010-8778-838cd1576215 could not be found. Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '2f2862cc-d10d-4010-8778-838cd1576215'} Sep 24 19:52:27.658779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f2862cc-d10d-4010-8778-838cd1576215 could not be found. (HTTP 404) (Request-ID: req-43ebf648-e0ad-4793-ab32-c2cf9e778ccc) Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:27.659713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:27.660984 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f2862cc-d10d-4010-8778-838cd1576215 could not be found. Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 19:52:27.662155 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f2862cc-d10d-4010-8778-838cd1576215 could not be found. Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f2862cc-d10d-4010-8778-838cd1576215 could not be found. Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b8898316-edc1-4373-bdc8-f26ff41d016e tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] Returning 404 to user: Volume 2f2862cc-d10d-4010-8778-838cd1576215 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b8898316-edc1-4373-bdc8-f26ff41d016e tempest-VolumesGetTestJSON-281129450 tempest-VolumesGetTestJSON-281129450-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215" status: 404 len: 109 microversion: 2.1 time: 0.049773 Sep 24 19:52:27.663486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 468/978] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:27 2022] GET /compute/v2.1/os-volumes/2f2862cc-d10d-4010-8778-838cd1576215 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:27.941539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:27.942623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:27.948064 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:27.953525 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:27.954541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:27.955251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:27.957083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:27.957899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:27.958649 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:28.151211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:28.159368 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e01d6807-d089-474f-8698-bc87493e9d33 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1507 microversion: 2.1 time: 0.226866 Sep 24 19:52:28.160202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 511/979] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:27 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:28.188945 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1baac371-a90b-4392-91e7-6057bb80170e", "device": "/dev/sdb"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:28.191516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:28.197607 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:28.198115 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:28.198533 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:28.199491 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:28.200293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:28.200732 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:28.536865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ce434814-8f31-40f8-92e9-5d8c2a1e7057 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "POST /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351910 Sep 24 19:52:28.537521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 469/980] 10.222.0.55 () {60 vars in 1323 bytes} [Sat Sep 24 19:52:28 2022] POST /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:28.662632 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:28.663137 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:28.669704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:28.670200 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:28.670644 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:28.671374 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:28.671870 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:28.672300 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:28.686490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] HTTP exception thrown: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Request method failure captured: Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 HTTP/1.1 Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL15BwZnLWR4lBFv1yIqac9ijLPSDz3M0gzPzALA6RIN0hgVdBp-fLTmxcKySAJ9vvEZrv_wHn7B7xLMzUIAOIsyNt-rb6_YU8RwVNv5ZXLiLJ518R57slhX_gO8fFwLhu1f0WF5r580B9NzuseHOK1sF0PiHfgzBx8DJfgquD_tfuNk Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:28.688579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 6974a4c8fffd4bc2933e754770cb912e Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.689982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '2c550fec-675d-43cd-9f53-9d9e3393ce01'} Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:28.690827 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.692079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.695252 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Returning 404 to user: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:28.696329 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e3cbb1f0-54ef-499d-a1b6-d9c39dccb8a4 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 404 len: 111 microversion: 2.20 time: 0.038453 Sep 24 19:52:28.697621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 512/981] 10.222.0.55 () {60 vars in 1280 bytes} [Sat Sep 24 19:52:28 2022] DELETE /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:52:28.711048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:28.712943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: 2c550fec-675d-43cd-9f53-9d9e3393ce01] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:28.723206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:28.723835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:28.724330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:28.725310 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:28.725943 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:28.726544 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:28.748097 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] HTTP exception thrown: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Request method failure captured: Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 HTTP/1.1 Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL15BwZnLWR4lBFv1yIqac9ijLPSDz3M0gzPzALA6RIN0hgVdBp-fLTmxcKySAJ9vvEZrv_wHn7B7xLMzUIAOIsyNt-rb6_YU8RwVNv5ZXLiLJ518R57slhX_gO8fFwLhu1f0WF5r580B9NzuseHOK1sF0PiHfgzBx8DJfgquD_tfuNk Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:28.751164 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 6974a4c8fffd4bc2933e754770cb912e Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.752729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '2c550fec-675d-43cd-9f53-9d9e3393ce01'} Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:28.753681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. Sep 24 19:52:28.754918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:28.756081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Returning 404 to user: Instance 2c550fec-675d-43cd-9f53-9d9e3393ce01 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:28.756081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b7f57698-3fc1-4f94-be23-1aa0ebbf02ef tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01" status: 404 len: 111 microversion: 2.20 time: 0.049382 Sep 24 19:52:28.757763 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 470/982] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:52:28 2022] GET /compute/v2.1/servers/2c550fec-675d-43cd-9f53-9d9e3393ce01 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:52:30.063170 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:30.063788 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:30.070410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:30.070984 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:30.071815 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:30.072540 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:30.073005 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:30.073619 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:30.088086 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] HTTP exception thrown: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Request method failure captured: Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 HTTP/1.1 Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL15BwZnLWR4lBFv1yIqac9ijLPSDz3M0gzPzALA6RIN0hgVdBp-fLTmxcKySAJ9vvEZrv_wHn7B7xLMzUIAOIsyNt-rb6_YU8RwVNv5ZXLiLJ518R57slhX_gO8fFwLhu1f0WF5r580B9NzuseHOK1sF0PiHfgzBx8DJfgquD_tfuNk Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:30.090191 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 6974a4c8fffd4bc2933e754770cb912e Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.092382 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': 'bff567a7-861e-469a-913d-add40f3220c9'} Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:30.093287 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.094712 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.096801 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Returning 404 to user: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:30.097696 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3b7c489e-59cf-4c04-ba99-23b3714becd7 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "DELETE /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 404 len: 111 microversion: 2.20 time: 0.045715 Sep 24 19:52:30.098251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 513/983] 10.222.0.55 () {60 vars in 1280 bytes} [Sat Sep 24 19:52:30 2022] DELETE /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:52:30.109168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:30.109862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] [instance: bff567a7-861e-469a-913d-add40f3220c9] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:30.116739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:30.117320 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:30.117993 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:30.118725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:30.119476 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:30.119911 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:30.135129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] HTTP exception thrown: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Request method failure captured: Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 HTTP/1.1 Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL15BwZnLWR4lBFv1yIqac9ijLPSDz3M0gzPzALA6RIN0hgVdBp-fLTmxcKySAJ9vvEZrv_wHn7B7xLMzUIAOIsyNt-rb6_YU8RwVNv5ZXLiLJ518R57slhX_gO8fFwLhu1f0WF5r580B9NzuseHOK1sF0PiHfgzBx8DJfgquD_tfuNk Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:30.137023 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3417cf79d7d748d483e8aeb8289b75f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 3417cf79d7d748d483e8aeb8289b75f6 Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-722764310 Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 6974a4c8fffd4bc2933e754770cb912e Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-722764310-project Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.138550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': 'bff567a7-861e-469a-913d-add40f3220c9'} Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:30.139305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. Sep 24 19:52:30.141080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:30.142979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] Returning 404 to user: Instance bff567a7-861e-469a-913d-add40f3220c9 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:30.142979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-004d58f8-50df-47d5-8929-a92fd95a1327 tempest-AttachVolumeShelveTestJSON-722764310 tempest-AttachVolumeShelveTestJSON-722764310-project] 10.222.0.55 "GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9" status: 404 len: 111 microversion: 2.20 time: 0.034243 Sep 24 19:52:30.142979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 471/984] 10.222.0.55 () {60 vars in 1277 bytes} [Sat Sep 24 19:52:30 2022] GET /compute/v2.1/servers/bff567a7-861e-469a-913d-add40f3220c9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 19:52:35.052568 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-a2c73ab4-845d-4d54-9b1e-7c828add1bd3 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Action: 'create', calling method: .version_select at 0x7f5417bbd940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1894355904"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:35.385727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-a2c73ab4-845d-4d54-9b1e-7c828add1bd3 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.460990 Sep 24 19:52:35.387684 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 514/985] 10.222.0.55 () {60 vars in 1155 bytes} [Sat Sep 24 19:52:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 463 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 19:52:35.401766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-923c9d4d-ceb8-4f66-bc82-296beb6ea1fc tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417e29ca0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:35.458573 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-923c9d4d-ceb8-4f66-bc82-296beb6ea1fc tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 200 len: 345 microversion: 2.1 time: 0.061194 Sep 24 19:52:35.459148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 472/986] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:35 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:52:35.514845 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:35.518312 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:35.519996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-cf23d50a-23e2-4f86-9f79-1145e35c5e9b req-b8ff5a2a-9c69-4cfd-88d4-885c5a94d7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef25795-8222-4f8a-9427-86abea7da3d8", "tag": "5e05d20f-c1e7-402f-9255-05129dfbe981"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:35.525887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:35.526422 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:35.526873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:35.527741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:35.528351 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:35.528793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:35.531772 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-cf23d50a-23e2-4f86-9f79-1145e35c5e9b req-b8ff5a2a-9c69-4cfd-88d4-885c5a94d7d0 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:35.532470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-cf23d50a-23e2-4f86-9f79-1145e35c5e9b req-b8ff5a2a-9c69-4cfd-88d4-885c5a94d7d0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:35.533121 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-cf23d50a-23e2-4f86-9f79-1145e35c5e9b req-b8ff5a2a-9c69-4cfd-88d4-885c5a94d7d0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:35.544152 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-cf23d50a-23e2-4f86-9f79-1145e35c5e9b req-b8ff5a2a-9c69-4cfd-88d4-885c5a94d7d0 service nova] Creating event network-changed:5e05d20f-c1e7-402f-9255-05129dfbe981 for instance 4ef25795-8222-4f8a-9427-86abea7da3d8 on hv-cinder-85919 Sep 24 19:52:35.550177 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-cf23d50a-23e2-4f86-9f79-1145e35c5e9b req-b8ff5a2a-9c69-4cfd-88d4-885c5a94d7d0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033558 Sep 24 19:52:35.551096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 473/987] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:35.561849 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:52:35.650459 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5c9d1ed5-c84f-468e-b272-f8adf9edeeb8 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 204 len: 0 microversion: 2.1 time: 0.139993 Sep 24 19:52:35.651457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 515/988] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:52:35 2022] DELETE /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:52:35.660277 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:35.661231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:35.667381 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:35.668669 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:35.669234 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:35.670222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:35.670685 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:35.671341 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:35.816295 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:35.824980 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d3f98e0d-e7da-4cb7-a2ac-5d4e66fc6287 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.168926 Sep 24 19:52:35.825739 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 474/989] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:35 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:36.476623 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e566c1e1-67f2-4242-a6c8-135a869d1e7c tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417c3f4c0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:36.528922 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e566c1e1-67f2-4242-a6c8-135a869d1e7c tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 200 len: 345 microversion: 2.1 time: 0.056508 Sep 24 19:52:36.529480 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 516/990] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:36 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:36.848810 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:36.849350 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:36.856178 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:36.856854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:36.857126 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:36.857858 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:36.858510 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:36.859080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:36.988154 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:36.996308 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-adc5edd6-12ce-4627-bb7b-98da28002aa2 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.150950 Sep 24 19:52:36.996871 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 475/991] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:36 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:37.544953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-70c31ecf-c8de-45c9-bcee-86b05b32a96a tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417f869d0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:37.596832 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-70c31ecf-c8de-45c9-bcee-86b05b32a96a tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 200 len: 346 microversion: 2.1 time: 0.057411 Sep 24 19:52:37.597407 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 517/992] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:37 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:37.610934 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2c81be8a-dbbc-4f84-a762-1c97ed397bdf tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Action: 'create', calling method: .version_select at 0x7f5417b02d30>, body: {"snapshot": {"volume_id": "857292a4-2011-49ac-825f-9c67208b61a3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1765668513"}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:37.785133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2c81be8a-dbbc-4f84-a762-1c97ed397bdf tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.178093 Sep 24 19:52:37.785919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 476/993] 10.222.0.55 () {60 vars in 1162 bytes} [Sat Sep 24 19:52:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:37.798501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-17ce9a44-f04d-4144-8e6d-2b1f3a215651 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417975280>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:37.835560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-17ce9a44-f04d-4144-8e6d-2b1f3a215651 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 200 len: 287 microversion: 2.1 time: 0.041742 Sep 24 19:52:37.846779 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 518/994] 10.222.0.55 () {58 vars in 1251 bytes} [Sat Sep 24 19:52:37 2022] GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:37.850809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-50c73d3f-b6dd-4b44-8805-84541527f38c tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417ab7a60>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:37.889619 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-50c73d3f-b6dd-4b44-8805-84541527f38c tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.043237 Sep 24 19:52:37.890190 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 477/995] 10.222.0.55 () {58 vars in 1140 bytes} [Sat Sep 24 19:52:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:37.903352 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5268d7ab-4b95-41f3-8eb2-20af19df79cc tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f54179755e0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:37.937696 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5268d7ab-4b95-41f3-8eb2-20af19df79cc tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 200 len: 287 microversion: 2.1 time: 0.038753 Sep 24 19:52:37.938939 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 519/996] 10.222.0.55 () {58 vars in 1251 bytes} [Sat Sep 24 19:52:37 2022] GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:38.019337 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:38.019990 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:38.025917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:38.026409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:38.026853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:38.027781 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:38.028245 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:38.028679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:38.175406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:38.183910 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-447dd761-19ab-47c4-ba78-6dff72fd3ae0 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.167910 Sep 24 19:52:38.184473 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 478/997] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:38 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:38.952641 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-e2f98e82-0af4-4891-8f5f-718d80068add tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417bf0d30>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:38.983810 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-e2f98e82-0af4-4891-8f5f-718d80068add tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 200 len: 287 microversion: 2.1 time: 0.036336 Sep 24 19:52:38.984379 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 520/998] 10.222.0.55 () {58 vars in 1251 bytes} [Sat Sep 24 19:52:38 2022] GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:39.207147 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:39.207853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:39.214706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:39.215326 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:39.215808 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:39.216517 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:39.216982 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:39.217409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:39.361890 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:39.372329 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-54026137-c512-490e-b922-8ab1f9671490 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.169414 Sep 24 19:52:39.372920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 479/999] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:39 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:39.998175 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-30beaf40-b50e-495f-a23f-fc64d5dca418 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417bbc280>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:40.029727 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-30beaf40-b50e-495f-a23f-fc64d5dca418 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 200 len: 287 microversion: 2.1 time: 0.036490 Sep 24 19:52:40.030308 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 521/1000] 10.222.0.55 () {58 vars in 1251 bytes} [Sat Sep 24 19:52:39 2022] GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:40.397178 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:40.397781 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:40.405919 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:40.406409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:40.406852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:40.407627 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:40.408222 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:40.408687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:40.557241 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:40.565687 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-fcb3b4c7-7958-400b-ab5f-e0bbbe5b266b tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1569 microversion: 2.1 time: 0.172740 Sep 24 19:52:40.566237 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 480/1001] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:40 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:52:41.043685 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-df4a6f53-4d24-457d-9ff7-6312fe75a339 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417bf08b0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:41.101908 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-df4a6f53-4d24-457d-9ff7-6312fe75a339 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 200 len: 288 microversion: 2.1 time: 0.062721 Sep 24 19:52:41.102933 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 522/1002] 10.222.0.55 () {58 vars in 1251 bytes} [Sat Sep 24 19:52:41 2022] GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 288 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:41.114402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6599cedc-be3c-4a92-b051-41050da1d5ce tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417a87ca0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:41.197494 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6599cedc-be3c-4a92-b051-41050da1d5ce tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 202 len: 0 microversion: 2.1 time: 0.087282 Sep 24 19:52:41.198075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 481/1003] 10.222.0.55 () {58 vars in 1254 bytes} [Sat Sep 24 19:52:41 2022] DELETE /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:52:41.210145 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-327a9e0b-dd8e-421a-aa80-527a1ebaf8b1 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417e23940>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:41.337539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-327a9e0b-dd8e-421a-aa80-527a1ebaf8b1 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 200 len: 287 microversion: 2.1 time: 0.134276 Sep 24 19:52:41.338659 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 523/1004] 10.222.0.55 () {58 vars in 1251 bytes} [Sat Sep 24 19:52:41 2022] GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 287 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:41.592134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:41.593395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:41.601681 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:41.603196 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:41.603887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:41.604767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:41.605362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:41.605935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:41.696912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:41.706778 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-256240e8-b143-4119-9540-e5e1f8dfb7fc tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1383 microversion: 2.1 time: 0.121223 Sep 24 19:52:41.707683 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 482/1005] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:41 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1383 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:41.805289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-309c3368-b014-433a-b350-869e4c84436c req-915ade76-74e3-4e2a-9648-e490f8796d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef25795-8222-4f8a-9427-86abea7da3d8", "name": "network-vif-deleted", "tag": "5e05d20f-c1e7-402f-9255-05129dfbe981"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:52:41.817265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-309c3368-b014-433a-b350-869e4c84436c req-915ade76-74e3-4e2a-9648-e490f8796d16 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:41.817982 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-309c3368-b014-433a-b350-869e4c84436c req-915ade76-74e3-4e2a-9648-e490f8796d16 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:41.818585 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-309c3368-b014-433a-b350-869e4c84436c req-915ade76-74e3-4e2a-9648-e490f8796d16 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:41.831606 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-309c3368-b014-433a-b350-869e4c84436c req-915ade76-74e3-4e2a-9648-e490f8796d16 service nova] Creating event network-vif-deleted:5e05d20f-c1e7-402f-9255-05129dfbe981 for instance 4ef25795-8222-4f8a-9427-86abea7da3d8 on hv-cinder-85919 Sep 24 19:52:41.837439 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-309c3368-b014-433a-b350-869e4c84436c req-915ade76-74e3-4e2a-9648-e490f8796d16 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036251 Sep 24 19:52:41.838304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 524/1006] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:42.351479 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ceea81e7-507c-48bc-99b0-d58999c4ff25 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417a24ee0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:42.378876 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-ceea81e7-507c-48bc-99b0-d58999c4ff25 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] HTTP exception thrown: Snapshot 239c1618-9509-409b-a26f-5f94fbee5682 could not be found. Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ceea81e7-507c-48bc-99b0-d58999c4ff25 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Request method failure captured: Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 HTTP/1.1 Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL2ACFiKZonNDQohgC_fUyTbO_EGMqL1xtHPpUl546j36qUfXikHHy8KqNd8JpW-b0eVtbIkTbtLjuNU-_iC0J4mCn5MApM-uiO0APqNIsUpcNWTW_hc2wURT4_-lShj1sJNSyFkYlvVgRLmrOlaJjqEXImI4VMZHDNkUXPMGjpoui_w Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:42.382061 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19addd8250b744629ce432f2c47777da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19addd8250b744629ce432f2c47777da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 229255d3e5d94652a05a2a5f3a7f8c6b Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Snapshot 239c1618-9509-409b-a26f-5f94fbee5682 could not be found. Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '239c1618-9509-409b-a26f-5f94fbee5682'} Sep 24 19:52:42.384163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 239c1618-9509-409b-a26f-5f94fbee5682 could not be found. (HTTP 404) (Request-ID: req-ca8959e8-1f6e-45b6-a7e3-a61337389e88) Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:42.385648 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:42.388482 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 239c1618-9509-409b-a26f-5f94fbee5682 could not be found. Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 24 19:52:42.390344 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 239c1618-9509-409b-a26f-5f94fbee5682 could not be found. Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 239c1618-9509-409b-a26f-5f94fbee5682 could not be found. Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ceea81e7-507c-48bc-99b0-d58999c4ff25 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Returning 404 to user: Snapshot 239c1618-9509-409b-a26f-5f94fbee5682 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:42.392542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ceea81e7-507c-48bc-99b0-d58999c4ff25 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682" status: 404 len: 111 microversion: 2.1 time: 0.036590 Sep 24 19:52:42.393796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 483/1007] 10.222.0.55 () {58 vars in 1251 bytes} [Sat Sep 24 19:52:42 2022] GET /compute/v2.1/os-snapshots/239c1618-9509-409b-a26f-5f94fbee5682 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:42.395458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-954a57c7-a2d6-4859-9055-945b08383563 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417975ee0>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:42.461394 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-954a57c7-a2d6-4859-9055-945b08383563 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 202 len: 0 microversion: 2.1 time: 0.070897 Sep 24 19:52:42.461969 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 525/1008] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:52:42 2022] DELETE /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:52:42.470873 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ef143620-d584-4560-b279-83b72a651fa5 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417b02670>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:42.529926 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ef143620-d584-4560-b279-83b72a651fa5 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 200 len: 345 microversion: 2.1 time: 0.062762 Sep 24 19:52:42.530866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 484/1009] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:42 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:42.742119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:42.742914 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:42.754669 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:42.755192 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:42.755658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:42.756467 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:42.757026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:42.757498 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:42.825231 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:42.833412 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-cf730a62-9ab6-4de0-b4c1-a0f595099dc7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1220 microversion: 2.1 time: 0.096273 Sep 24 19:52:42.833996 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 526/1010] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:42 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:43.548244 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a88892b5-faad-439c-80ae-929292a037ab tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417ab7040>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:43.598718 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a88892b5-faad-439c-80ae-929292a037ab tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 200 len: 345 microversion: 2.1 time: 0.055461 Sep 24 19:52:43.599294 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 485/1011] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:43 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:43.857114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:43.857815 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:43.863970 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:43.864692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:43.865172 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:43.865858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:43.866322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:43.866756 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:43.885865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:43.938915 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:43.946913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ffa8fdf5-d1ee-4833-8307-8a3fe16a2506 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1220 microversion: 2.1 time: 0.093819 Sep 24 19:52:43.947505 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 527/1012] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:43 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:44.613457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a2559df5-288f-4800-ae8c-29faa7b80d6d tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417ac25e0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:44.661443 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a2559df5-288f-4800-ae8c-29faa7b80d6d tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 200 len: 345 microversion: 2.1 time: 0.052257 Sep 24 19:52:44.662009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 486/1013] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:44 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:52:44.973980 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:44.974731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:44.982927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:44.983584 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:44.984169 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:44.985066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:44.985609 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:44.986115 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:45.051240 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:45.065549 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-fa968ace-426b-4336-8600-4694e5390de7 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1220 microversion: 2.1 time: 0.096388 Sep 24 19:52:45.066519 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 528/1014] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:44 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:45.682192 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-00bec2c9-474d-4e66-b0b7-f0b774061af4 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417b661f0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:45.738957 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-00bec2c9-474d-4e66-b0b7-f0b774061af4 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] HTTP exception thrown: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-00bec2c9-474d-4e66-b0b7-f0b774061af4 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Request method failure captured: Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 HTTP/1.1 Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL2ACFiKZonNDQohgC_fUyTbO_EGMqL1xtHPpUl546j36qUfXikHHy8KqNd8JpW-b0eVtbIkTbtLjuNU-_iC0J4mCn5MApM-uiO0APqNIsUpcNWTW_hc2wURT4_-lShj1sJNSyFkYlvVgRLmrOlaJjqEXImI4VMZHDNkUXPMGjpoui_w Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:45.746620 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19addd8250b744629ce432f2c47777da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19addd8250b744629ce432f2c47777da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 229255d3e5d94652a05a2a5f3a7f8c6b Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '857292a4-2011-49ac-825f-9c67208b61a3'} Sep 24 19:52:45.748240 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. (HTTP 404) (Request-ID: req-2ae130ff-0f97-4e4e-a9ae-dc20af69add2) Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.749195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:45.750767 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 19:52:45.752332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-00bec2c9-474d-4e66-b0b7-f0b774061af4 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Returning 404 to user: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-00bec2c9-474d-4e66-b0b7-f0b774061af4 tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 404 len: 109 microversion: 2.1 time: 0.075905 Sep 24 19:52:45.753815 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 487/1015] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:45 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:45.773741 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1a3d6ac8-9fbd-4241-9cf6-7840facd830e tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417e23940>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:45.818411 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-1a3d6ac8-9fbd-4241-9cf6-7840facd830e tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] HTTP exception thrown: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1a3d6ac8-9fbd-4241-9cf6-7840facd830e tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Request method failure captured: Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 HTTP/1.1 Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL2ACFiKZonNDQohgC_fUyTbO_EGMqL1xtHPpUl546j36qUfXikHHy8KqNd8JpW-b0eVtbIkTbtLjuNU-_iC0J4mCn5MApM-uiO0APqNIsUpcNWTW_hc2wURT4_-lShj1sJNSyFkYlvVgRLmrOlaJjqEXImI4VMZHDNkUXPMGjpoui_w Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:52:45.820854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19addd8250b744629ce432f2c47777da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19addd8250b744629ce432f2c47777da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 229255d3e5d94652a05a2a5f3a7f8c6b Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '857292a4-2011-49ac-825f-9c67208b61a3'} Sep 24 19:52:45.825918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. (HTTP 404) (Request-ID: req-fb5e5e51-48d4-4504-ac60-f39c89521ffe) Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.828878 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 19:52:45.831770 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 19:52:45.834450 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1a3d6ac8-9fbd-4241-9cf6-7840facd830e tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Returning 404 to user: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1a3d6ac8-9fbd-4241-9cf6-7840facd830e tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 404 len: 109 microversion: 2.1 time: 0.053891 Sep 24 19:52:45.837818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 529/1016] 10.222.0.55 () {58 vars in 1248 bytes} [Sat Sep 24 19:52:45 2022] DELETE /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:45.840030 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b0cc9381-f506-4146-a2b4-1e1b9526473a tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Calling method '.version_select at 0x7f5417b020d0>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:45.872690 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-b0cc9381-f506-4146-a2b4-1e1b9526473a tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] HTTP exception thrown: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b0cc9381-f506-4146-a2b4-1e1b9526473a tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Request method failure captured: Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 HTTP/1.1 Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL2ACFiKZonNDQohgC_fUyTbO_EGMqL1xtHPpUl546j36qUfXikHHy8KqNd8JpW-b0eVtbIkTbtLjuNU-_iC0J4mCn5MApM-uiO0APqNIsUpcNWTW_hc2wURT4_-lShj1sJNSyFkYlvVgRLmrOlaJjqEXImI4VMZHDNkUXPMGjpoui_w Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:45.874975 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_19addd8250b744629ce432f2c47777da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/19addd8250b744629ce432f2c47777da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/19addd8250b744629ce432f2c47777da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: 19addd8250b744629ce432f2c47777da Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-763407644 Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 229255d3e5d94652a05a2a5f3a7f8c6b Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesSnapshotsTestJSON-763407644-project Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '857292a4-2011-49ac-825f-9c67208b61a3'} Sep 24 19:52:45.877134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. (HTTP 404) (Request-ID: req-a6623e3c-7656-4607-b56f-1a04ff81dfa4) Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.878961 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 19:52:45.881345 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 19:52:45.883888 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b0cc9381-f506-4146-a2b4-1e1b9526473a tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] Returning 404 to user: Volume 857292a4-2011-49ac-825f-9c67208b61a3 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b0cc9381-f506-4146-a2b4-1e1b9526473a tempest-VolumesSnapshotsTestJSON-763407644 tempest-VolumesSnapshotsTestJSON-763407644-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3" status: 404 len: 109 microversion: 2.1 time: 0.047305 Sep 24 19:52:45.887080 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 488/1017] 10.222.0.55 () {58 vars in 1245 bytes} [Sat Sep 24 19:52:45 2022] GET /compute/v2.1/os-volumes/857292a4-2011-49ac-825f-9c67208b61a3 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:52:46.096114 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:46.097242 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:46.114729 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:46.115556 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:46.116326 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:46.117211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:46.117983 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:46.118580 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:46.192327 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:46.193262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:46.194078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:46.194607 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lazy-loading 'fault' on Instance uuid 4ef25795-8222-4f8a-9427-86abea7da3d8 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:52:46.251345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6cc144c0d804a84a8d35eaa57fab6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3250304054594abbaa610e49da216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:46.261879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1c6609e2-f05e-4998-bdbd-e8ebeeb35395 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 200 len: 1179 microversion: 2.1 time: 0.173048 Sep 24 19:52:46.262687 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 530/1018] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:46 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 1179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:47.290458 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:47.291081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] [instance: 4ef25795-8222-4f8a-9427-86abea7da3d8] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:47.293848 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:47.300317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:47.300915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:47.301366 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:47.302603 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:47.303236 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:47.303709 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:47.307655 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:47.332368 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] HTTP exception thrown: Instance 4ef25795-8222-4f8a-9427-86abea7da3d8 could not be found. Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Request method failure captured: Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 HTTP/1.1 Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL160KBFH-Ice6frL9RXlu4DUIOYXraBmqwYyqlVTIsi8jcoOTmFOtGMotI0Ox9KIcNRtXrlWa8ju7psr3KcfXmSHcj2XKhkEX5rxHF9oLK7_oeqMPc0cgUsPi9GkNOIMx-lutRXG0st0eicU_bmFhhdboWl-PBbPCim4-keWgQosiSQ Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: f5c3250304054594abbaa610e49da216 Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-TestShelveInstance-1204249354 Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:52:47.334933 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f5c3250304054594abbaa610e49da216"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f5c3250304054594abbaa610e49da216"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f5c3250304054594abbaa610e49da216"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f5c3250304054594abbaa610e49da216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-TestShelveInstance-1204249354 Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: f5c3250304054594abbaa610e49da216 Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-TestShelveInstance-1204249354 Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-TestShelveInstance-1204249354-project Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: e6cc144c0d804a84a8d35eaa57fab6bb Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-TestShelveInstance-1204249354-project Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 4ef25795-8222-4f8a-9427-86abea7da3d8 could not be found. Sep 24 19:52:47.336324 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '4ef25795-8222-4f8a-9427-86abea7da3d8'} Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef25795-8222-4f8a-9427-86abea7da3d8 could not be found. Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:52:47.337182 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef25795-8222-4f8a-9427-86abea7da3d8 could not be found. Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef25795-8222-4f8a-9427-86abea7da3d8 could not be found. Sep 24 19:52:47.342863 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:52:47.344847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Returning 404 to user: Instance 4ef25795-8222-4f8a-9427-86abea7da3d8 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:52:47.344847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2adfe546-ecf8-4e1a-861f-a4811a90436f tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8" status: 404 len: 111 microversion: 2.1 time: 0.053634 Sep 24 19:52:47.344847 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 489/1019] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:47 2022] GET /compute/v2.1/servers/4ef25795-8222-4f8a-9427-86abea7da3d8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:52:47.538334 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-94c4d740-6196-4a58-b306-8df27ea18e22 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] Calling method '.version_select at 0x7f5417bbdf70>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:47.551641 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:47.594322 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-94c4d740-6196-4a58-b306-8df27ea18e22 tempest-TestShelveInstance-1204249354 tempest-TestShelveInstance-1204249354-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1495379635" status: 202 len: 0 microversion: 2.1 time: 0.060583 Sep 24 19:52:47.594858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 531/1020] 10.222.0.55 () {58 vars in 1254 bytes} [Sat Sep 24 19:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1495379635 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 19:52:56.116759 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:56.117363 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:56.126055 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:56.126852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:56.127526 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:56.128450 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:56.129091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:56.129706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:56.312278 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lazy-loading 'services' on Instance uuid 148a9561-c865-4739-8da8-f60a315a0092 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:52:56.506731 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-98db1478-e8c6-4b33-9078-40bdd50fa837 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "DELETE /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092/os-volume_attachments/1baac371-a90b-4392-91e7-6057bb80170e" status: 202 len: 0 microversion: 2.1 time: 0.393847 Sep 24 19:52:56.509997 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 490/1021] 10.222.0.55 () {58 vars in 1416 bytes} [Sat Sep 24 19:52:56 2022] DELETE /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092/os-volume_attachments/1baac371-a90b-4392-91e7-6057bb80170e => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 19:52:57.723256 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:57.723885 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:57.735318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=16 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:52:57.743137 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:57.744565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:57.746489 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:57.747262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:57.748306 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:57.748936 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:57.785647 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:52:57.891265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-33b07e72-e08c-4153-939f-9f83d00f1ecb tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "DELETE /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 204 len: 0 microversion: 2.1 time: 0.175265 Sep 24 19:52:57.895497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 532/1022] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:52:57 2022] DELETE /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:52:57.905249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:57.906104 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:57.913166 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:57.913831 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:57.914382 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:57.915208 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:57.915809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:57.916475 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:58.092706 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:58.104550 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cdf70206-2a5e-4c9b-9dfd-ebb22d9b66f2 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1513 microversion: 2.1 time: 0.203467 Sep 24 19:52:58.119117 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 491/1023] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:57 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:52:59.131179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:52:59.132594 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:52:59.147379 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:59.149093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:59.149772 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:59.150604 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:52:59.151083 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:52:59.154098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:52:59.333043 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:52:59.342081 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-05069ee7-a684-4707-b852-a58dd4ac7808 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1513 microversion: 2.1 time: 0.215509 Sep 24 19:52:59.343338 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 533/1024] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:52:59 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:00.366779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:00.367527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:00.376966 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:00.377557 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:00.378009 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:00.379356 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:00.379883 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:00.380322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:00.611412 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:00.650093 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5cb20b45-5354-44aa-91d4-33eb57a84ad5 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1513 microversion: 2.1 time: 0.285873 Sep 24 19:53:00.650700 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 492/1025] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:00 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:00.717812 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-15d9be36-ff22-4ddf-9003-2ddbc2cc4e5a req-9c419654-29dd-48da-9ce3-fd3bd51dfaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148a9561-c865-4739-8da8-f60a315a0092", "name": "network-vif-deleted", "tag": "f1d85fae-e71e-48c3-9caf-612bf921e609"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:53:00.730830 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-15d9be36-ff22-4ddf-9003-2ddbc2cc4e5a req-9c419654-29dd-48da-9ce3-fd3bd51dfaf6 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:00.732579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-15d9be36-ff22-4ddf-9003-2ddbc2cc4e5a req-9c419654-29dd-48da-9ce3-fd3bd51dfaf6 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:00.733269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-15d9be36-ff22-4ddf-9003-2ddbc2cc4e5a req-9c419654-29dd-48da-9ce3-fd3bd51dfaf6 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:00.761207 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-15d9be36-ff22-4ddf-9003-2ddbc2cc4e5a req-9c419654-29dd-48da-9ce3-fd3bd51dfaf6 service nova] Creating event network-vif-deleted:f1d85fae-e71e-48c3-9caf-612bf921e609 for instance 148a9561-c865-4739-8da8-f60a315a0092 on hv-cinder-85919 Sep 24 19:53:00.770012 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-15d9be36-ff22-4ddf-9003-2ddbc2cc4e5a req-9c419654-29dd-48da-9ce3-fd3bd51dfaf6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061925 Sep 24 19:53:00.774449 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 534/1026] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:53:01.680644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:01.681911 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:01.696608 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:01.697131 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:01.697582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:01.698591 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:01.700719 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:01.701180 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:01.748862 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:01.749742 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:01.750457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:01.751167 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lazy-loading 'fault' on Instance uuid 148a9561-c865-4739-8da8-f60a315a0092 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:53:01.818193 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '875e4edde2834c8d9fd40cb219c4d2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd71c6be7e9d4741b129fbc0e6fafad4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:01.827726 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f58375c6-e578-46ff-a572-03886fdc5188 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 200 len: 1308 microversion: 2.1 time: 0.151820 Sep 24 19:53:01.828530 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 493/1027] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:01 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 1308 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:02.853559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:02.855539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] [instance: 148a9561-c865-4739-8da8-f60a315a0092] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:02.868791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:02.871068 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:02.872312 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:02.873318 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:02.873918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:02.874636 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:02.890292 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] HTTP exception thrown: Instance 148a9561-c865-4739-8da8-f60a315a0092 could not be found. Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Request method failure captured: Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 HTTP/1.1 Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL1-kHKY5PcHWjCtLyD_85uKYMYlbp35aX4sC024Okr21gfCmdfvlTfF_ZSfOxTASnUp50lRWz40W0thBhgngC5vXignmd0B50L2K1UDKQXi-jY93-nHr8XUR3Y1VpwaG_sYX5QQIQCnYoOUwDSbnfO4emqFEakff4oADzV0vjBsJ_EQ Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: bd71c6be7e9d4741b129fbc0e6fafad4 Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-VolumesSnapshotTestJSON-358269180 Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:53:02.892307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bd71c6be7e9d4741b129fbc0e6fafad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-VolumesSnapshotTestJSON-358269180 Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: bd71c6be7e9d4741b129fbc0e6fafad4 Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-358269180 Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-VolumesSnapshotTestJSON-358269180-project Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 875e4edde2834c8d9fd40cb219c4d2fd Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-VolumesSnapshotTestJSON-358269180-project Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 148a9561-c865-4739-8da8-f60a315a0092 could not be found. Sep 24 19:53:02.894042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '148a9561-c865-4739-8da8-f60a315a0092'} Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148a9561-c865-4739-8da8-f60a315a0092 could not be found. Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:53:02.895108 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148a9561-c865-4739-8da8-f60a315a0092 could not be found. Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148a9561-c865-4739-8da8-f60a315a0092 could not be found. Sep 24 19:53:02.896730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:53:02.899667 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] Returning 404 to user: Instance 148a9561-c865-4739-8da8-f60a315a0092 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:53:02.900752 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-09b699d5-f991-4fbd-91df-31c092993d26 tempest-VolumesSnapshotTestJSON-358269180 tempest-VolumesSnapshotTestJSON-358269180-project] 10.222.0.55 "GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092" status: 404 len: 111 microversion: 2.1 time: 0.052287 Sep 24 19:53:02.902119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 535/1028] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:02 2022] GET /compute/v2.1/servers/148a9561-c865-4739-8da8-f60a315a0092 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:53:13.904032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=11 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:53:13.905271 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:53:14.462243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-30a1c6a8-b728-465d-a824-a03b0c587d5e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Action: 'create', calling method: .version_select at 0x7f5417b66280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1412825204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXfs3QtLf5PNJQ5YPIRkzOP9Ve6xxO+3O2AHOE93EUCcQIOyj7ExotGVMFnL2U5+WWia3BpR3gtL95/qnheIxNSzEPAisUQ6cdvzFaXFgvawefKnl0BJINQBkCeYuDVJw=="}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:53:14.489924 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-30a1c6a8-b728-465d-a824-a03b0c587d5e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for project d308ae5684724251aa1011f269cf466a. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:53:14.497343 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-30a1c6a8-b728-465d-a824-a03b0c587d5e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for user 94533495d9ea4e489e7283dbf307ae66 and project d308ae5684724251aa1011f269cf466a. Resources: {'key_pairs'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:53:14.537595 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-30a1c6a8-b728-465d-a824-a03b0c587d5e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.638897 Sep 24 19:53:14.544269 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 494/1029] 10.222.0.55 () {60 vars in 1159 bytes} [Sat Sep 24 19:53:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:53:49.216511 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1643468657", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1412825204", "security_groups": [{"name": "tempest-secgroup-smoke-1849033028"}], "block_device_mapping_v2": [{"uuid": "7d35f454-d345-4a75-a74a-c50ae3dcf777", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "687c9eeb-bbdd-4f20-9be2-93d6692b6d9b"}]}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:53:49.228916 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:53:49.229765 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:53:49.348655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] validate_networks() for [('687c9eeb-bbdd-4f20-9be2-93d6692b6d9b', None, None, None, None, None)] {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:53:49.754431 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:53:49.754855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:53:49.755559 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:53:49.756125 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:53:49.756618 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:53:49.766701 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:49.767514 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:49.767963 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:49.768978 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:49.769448 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:49.769917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:49.788590 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for project d308ae5684724251aa1011f269cf466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:53:49.793393 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for user 94533495d9ea4e489e7283dbf307ae66 and project d308ae5684724251aa1011f269cf466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:53:49.878992 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:53:49.881683 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d35f454-d345-4a75-a74a-c50ae3dcf777',volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:53:50.056574 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-31801b7f-ba48-4d67-9bb0-31d954dec44b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.843723 Sep 24 19:53:50.060831 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 536/1030] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:53:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:53:50.082646 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1cb28e1a-fa08-4a63-9c90-9ad19bca1afd tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:50.084922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1cb28e1a-fa08-4a63-9c90-9ad19bca1afd tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:50.088565 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=4 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:53:50.090328 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:53:50.174114 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-1cb28e1a-fa08-4a63-9c90-9ad19bca1afd tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:50.186896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1cb28e1a-fa08-4a63-9c90-9ad19bca1afd tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1095 microversion: 2.1 time: 0.106399 Sep 24 19:53:50.188421 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 495/1031] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:50 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1095 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:51.214944 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:51.217055 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:51.223262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:51.223876 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:51.224386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:51.225188 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:51.225720 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:51.226219 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:51.297213 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:51.305854 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-abed9a29-ac68-41c9-8a9c-e371219a3ce4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1193 microversion: 2.1 time: 0.097197 Sep 24 19:53:51.307121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 537/1032] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:51 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:53:52.333364 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:52.334068 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:52.342330 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:52.343118 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:52.343769 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:52.344713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:52.345305 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:52.345816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:52.564245 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:52.574679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b326368a-97c5-4794-ac9c-a3dde7000136 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1279 microversion: 2.1 time: 0.243639 Sep 24 19:53:52.590599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 496/1033] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:52 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:53.116389 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-fd415c27-ce4c-43d7-a92b-3bf0a46c8ca2 req-88d3cca1-c970-4fe9-af4e-02a010713de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d1c0336-0f9c-4109-b44d-72fc095fed33", "tag": "e10b4fe8-b11f-4dac-bed1-078a2684853b"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:53:53.130341 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fd415c27-ce4c-43d7-a92b-3bf0a46c8ca2 req-88d3cca1-c970-4fe9-af4e-02a010713de2 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:53.145357 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fd415c27-ce4c-43d7-a92b-3bf0a46c8ca2 req-88d3cca1-c970-4fe9-af4e-02a010713de2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:53.145929 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-fd415c27-ce4c-43d7-a92b-3bf0a46c8ca2 req-88d3cca1-c970-4fe9-af4e-02a010713de2 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:53.168500 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-fd415c27-ce4c-43d7-a92b-3bf0a46c8ca2 req-88d3cca1-c970-4fe9-af4e-02a010713de2 service nova] Creating event network-changed:e10b4fe8-b11f-4dac-bed1-078a2684853b for instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 on hv-cinder-85919 Sep 24 19:53:53.174605 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-fd415c27-ce4c-43d7-a92b-3bf0a46c8ca2 req-88d3cca1-c970-4fe9-af4e-02a010713de2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062316 Sep 24 19:53:53.175749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 538/1034] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:53:53.601304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:53.601927 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:53.614941 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:53.615475 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:53.615925 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:53.616641 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:53.617293 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:53.617724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:53.773439 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:53.781845 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-a24a776c-760a-4ac8-903e-64d946221813 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1267 microversion: 2.1 time: 0.184443 Sep 24 19:53:53.782417 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 497/1035] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:53 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:54.809567 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:54.810273 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:54.816730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:54.817344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:54.817786 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:54.818499 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:54.818963 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:54.819417 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:55.067635 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:55.079972 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-0d6e5ef4-7010-4f63-a474-e9327dcbd5d4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1267 microversion: 2.1 time: 0.275960 Sep 24 19:53:55.080646 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 539/1036] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:54 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:56.103622 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:56.104467 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:56.128856 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:56.129367 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:56.129820 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:56.130543 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:56.131015 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:56.131470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:56.303591 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:56.312405 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3a7e04e9-910a-490c-862f-96edd0873288 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1267 microversion: 2.1 time: 0.212657 Sep 24 19:53:56.315470 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 498/1037] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:56 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:57.336160 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:57.336781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:57.343976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:57.344494 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:57.345045 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:57.345640 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:57.346138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:57.346567 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:57.481944 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:57.489783 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-68e9a1d0-ddb1-4fde-8d46-96a21c3b4145 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1267 microversion: 2.1 time: 0.158025 Sep 24 19:53:57.490347 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 540/1038] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:57 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:58.385511 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-23edea65-5f75-4de8-b5ff-b2666d18fc79 req-e4b8272c-660a-4d1f-a90c-c644b147eef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d1c0336-0f9c-4109-b44d-72fc095fed33", "name": "network-vif-plugged", "status": "completed", "tag": "e10b4fe8-b11f-4dac-bed1-078a2684853b"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:53:58.396410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-23edea65-5f75-4de8-b5ff-b2666d18fc79 req-e4b8272c-660a-4d1f-a90c-c644b147eef3 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:58.396820 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-23edea65-5f75-4de8-b5ff-b2666d18fc79 req-e4b8272c-660a-4d1f-a90c-c644b147eef3 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:58.397277 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-23edea65-5f75-4de8-b5ff-b2666d18fc79 req-e4b8272c-660a-4d1f-a90c-c644b147eef3 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:58.410058 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-23edea65-5f75-4de8-b5ff-b2666d18fc79 req-e4b8272c-660a-4d1f-a90c-c644b147eef3 service nova] Creating event network-vif-plugged:e10b4fe8-b11f-4dac-bed1-078a2684853b for instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 on hv-cinder-85919 Sep 24 19:53:58.415298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-23edea65-5f75-4de8-b5ff-b2666d18fc79 req-e4b8272c-660a-4d1f-a90c-c644b147eef3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034248 Sep 24 19:53:58.416332 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 499/1039] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:53:58.514339 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:58.515452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:58.522224 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:58.522797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:58.523313 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:58.524125 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:58.524660 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:58.525834 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:58.701724 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:58.710496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4ef18967-d177-4d46-95fb-c1f360a3023b tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1267 microversion: 2.1 time: 0.201401 Sep 24 19:53:58.711288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 541/1040] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:58 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:53:59.735327 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:53:59.736430 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:53:59.742689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:59.743071 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:59.744178 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:59.745092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:53:59.745556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:53:59.746028 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:53:59.904571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:53:59.912631 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-67458ded-dd41-41a2-a464-b7098777fc04 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1267 microversion: 2.1 time: 0.182049 Sep 24 19:53:59.913205 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 500/1041] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:53:59 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:00.938373 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:00.939419 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:00.942858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:00.943993 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:00.951879 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:00.952383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:00.952826 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:00.953637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:00.954161 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:00.954569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:01.091227 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:01.099526 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-315d61ab-3e1f-4625-a525-ed0d2e22d243 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1454 microversion: 2.1 time: 0.165653 Sep 24 19:54:01.100091 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 542/1042] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:00 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:01.120970 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:01.126586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:01.127214 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:01.136396 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:01.136905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:01.137351 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:01.138081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:01.138574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:01.139011 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:01.293285 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:01.301839 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ae7c7ccd-bf6a-416a-ae0c-80fae38d3ad8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1454 microversion: 2.1 time: 0.181903 Sep 24 19:54:01.302415 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 501/1043] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:01 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:03.170744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-908745458", "imageRef": "1328d445-3592-4819-a577-613e0071a4f9", "flavorRef": "452"}} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:54:03.229575 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-5d0894fa-d512-46bd-a661-1dd16a34e0f1 req-3dc57978-97ed-4926-8838-ae6611a5d7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d1c0336-0f9c-4109-b44d-72fc095fed33", "tag": "e10b4fe8-b11f-4dac-bed1-078a2684853b"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:54:03.239661 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.network.neutron [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] validate_networks() for None {{(pid=127045) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:54:03.242179 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-5d0894fa-d512-46bd-a661-1dd16a34e0f1 req-3dc57978-97ed-4926-8838-ae6611a5d7bc service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:03.242867 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-5d0894fa-d512-46bd-a661-1dd16a34e0f1 req-3dc57978-97ed-4926-8838-ae6611a5d7bc service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:03.244050 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-5d0894fa-d512-46bd-a661-1dd16a34e0f1 req-3dc57978-97ed-4926-8838-ae6611a5d7bc service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:03.258715 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-5d0894fa-d512-46bd-a661-1dd16a34e0f1 req-3dc57978-97ed-4926-8838-ae6611a5d7bc service nova] Creating event network-changed:e10b4fe8-b11f-4dac-bed1-078a2684853b for instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 on hv-cinder-85919 Sep 24 19:54:03.265636 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-5d0894fa-d512-46bd-a661-1dd16a34e0f1 req-3dc57978-97ed-4926-8838-ae6611a5d7bc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042114 Sep 24 19:54:03.273794 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 502/1044] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:54:03.908767 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Flavor limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:54:03.909278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Image limits 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:54:03.909765 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Flavor pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:54:03.910183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Image pref 0:0:0 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:54:03.910769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.virt.hardware [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:54:03.923212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:03.924237 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:03.924729 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:03.925551 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:03.926023 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:03.926459 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:03.943975 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Getting quotas for project da4a689e57aa4fc8a6bc9adc4891188a. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:54:03.948657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.quota [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Getting quotas for user 8394b3206e4846cca84e9ba8a1c5baa4 and project da4a689e57aa4fc8a6bc9adc4891188a. Resources: {'cores', 'instances', 'ram'} {{(pid=127045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:54:03.961692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Going to run 1 instances... {{(pid=127045) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:54:03.965396 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1328d445-3592-4819-a577-613e0071a4f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:54:04.016887 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-257a0b20-50e9-43d3-b374-cfda2123a94b tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851191 Sep 24 19:54:04.018187 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 543/1045] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:54:04.033674 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4d39ca6d-fe4c-4f6d-af24-57b2ecb3ab1f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:04.034480 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4d39ca6d-fe4c-4f6d-af24-57b2ecb3ab1f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:04.110317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4d39ca6d-fe4c-4f6d-af24-57b2ecb3ab1f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:04.119658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4d39ca6d-fe4c-4f6d-af24-57b2ecb3ab1f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1214 microversion: 2.1 time: 0.089816 Sep 24 19:54:04.121713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 503/1046] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:04 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:05.145463 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:05.146093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:05.153579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:05.154076 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:05.154699 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:05.155630 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:05.156099 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:05.156520 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:05.236896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:05.246817 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-22eaa707-73ae-4d1a-b9b9-54c927de49f1 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1266 microversion: 2.1 time: 0.105719 Sep 24 19:54:05.247833 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 544/1047] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:05 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:06.273517 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:06.274501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:06.282553 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:06.283133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:06.283690 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:06.284507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:06.285046 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:06.290576 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:06.456123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:06.467173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f52f3e93-ae19-47cb-a7ef-b3f4f5fb7af8 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1314 microversion: 2.1 time: 0.198571 Sep 24 19:54:06.477809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 504/1048] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:06 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:07.062235 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-80f9e01a-6dd9-47be-89bc-c4d432e117e9 req-444f6fad-8ba8-4ea3-bc17-5245aa912de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b723a04-55d8-42e5-ad5f-8d062f8581fd", "tag": "7ef8cbd0-c902-4032-8bb0-359e88c170ca"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:54:07.080416 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-80f9e01a-6dd9-47be-89bc-c4d432e117e9 req-444f6fad-8ba8-4ea3-bc17-5245aa912de0 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:07.081823 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-80f9e01a-6dd9-47be-89bc-c4d432e117e9 req-444f6fad-8ba8-4ea3-bc17-5245aa912de0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:07.082596 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-80f9e01a-6dd9-47be-89bc-c4d432e117e9 req-444f6fad-8ba8-4ea3-bc17-5245aa912de0 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:07.101433 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-80f9e01a-6dd9-47be-89bc-c4d432e117e9 req-444f6fad-8ba8-4ea3-bc17-5245aa912de0 service nova] Creating event network-changed:7ef8cbd0-c902-4032-8bb0-359e88c170ca for instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd on hv-cinder-85919 Sep 24 19:54:07.107073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-80f9e01a-6dd9-47be-89bc-c4d432e117e9 req-444f6fad-8ba8-4ea3-bc17-5245aa912de0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048573 Sep 24 19:54:07.108330 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 545/1049] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:54:07.491671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:07.492218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:07.498915 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:07.499441 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:07.499896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:07.500632 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:07.501091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:07.501524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:07.663057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:07.672159 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f570c20c-1b33-43ec-a1e4-6654cf41f0c5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1314 microversion: 2.1 time: 0.185124 Sep 24 19:54:07.672753 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 505/1050] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:07 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:08.696241 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:08.697731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:08.704307 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:08.704805 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:08.705251 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:08.705963 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:08.706430 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:08.706865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:08.912666 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:08.921616 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-aa11fc2f-ed22-4805-bc6a-4798d63f2b94 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1314 microversion: 2.1 time: 0.230395 Sep 24 19:54:08.922197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 546/1051] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:08 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:09.944828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:09.945549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:09.952564 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:09.953057 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:09.953501 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:09.954202 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:09.954659 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:09.955088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:10.085049 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:10.093298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3d9b4819-7753-4c7b-a7a0-68286c540595 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1314 microversion: 2.1 time: 0.152256 Sep 24 19:54:10.093909 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 506/1052] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:09 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:11.117335 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:11.117926 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:11.125151 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:11.125657 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:11.126124 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:11.126822 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:11.127289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:11.127749 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:11.261624 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:11.269346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4cfad960-f3e3-4786-8869-a9f24f60345f tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1314 microversion: 2.1 time: 0.155966 Sep 24 19:54:11.269909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 547/1053] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:11 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:12.293545 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:12.294169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:12.301035 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:12.301531 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:12.301971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:12.302676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:12.303133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:12.303590 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:12.437081 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-d63866bc-dee5-4301-a6f5-6b1eb2c990e1 req-c82d570e-7dc5-4156-80a6-01d4f714e851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b723a04-55d8-42e5-ad5f-8d062f8581fd", "name": "network-vif-plugged", "status": "completed", "tag": "7ef8cbd0-c902-4032-8bb0-359e88c170ca"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:54:12.448565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d63866bc-dee5-4301-a6f5-6b1eb2c990e1 req-c82d570e-7dc5-4156-80a6-01d4f714e851 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:12.449004 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:12.449297 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d63866bc-dee5-4301-a6f5-6b1eb2c990e1 req-c82d570e-7dc5-4156-80a6-01d4f714e851 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:12.449747 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-d63866bc-dee5-4301-a6f5-6b1eb2c990e1 req-c82d570e-7dc5-4156-80a6-01d4f714e851 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:12.461214 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-8b6eaee3-b2c2-4692-a2d8-c14ec08641a7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1314 microversion: 2.1 time: 0.172555 Sep 24 19:54:12.461538 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-d63866bc-dee5-4301-a6f5-6b1eb2c990e1 req-c82d570e-7dc5-4156-80a6-01d4f714e851 service nova] Creating event network-vif-plugged:7ef8cbd0-c902-4032-8bb0-359e88c170ca for instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd on hv-cinder-85919 Sep 24 19:54:12.462983 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 507/1054] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:12 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:12.467817 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-d63866bc-dee5-4301-a6f5-6b1eb2c990e1 req-c82d570e-7dc5-4156-80a6-01d4f714e851 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036022 Sep 24 19:54:12.468539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 548/1055] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:54:13.486140 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:13.486764 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:13.493352 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:13.494599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:13.495123 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:13.495912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:13.496374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:13.496810 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:13.634243 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:13.642129 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b2384652-76b9-46ec-8e75-c6429893ee37 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1314 microversion: 2.1 time: 0.159990 Sep 24 19:54:13.642692 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 508/1056] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:13 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:14.663360 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:14.664150 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:14.669332 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:14.670436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:14.677515 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:14.678123 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:14.678572 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:14.679275 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:14.679787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:14.680246 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:14.815899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:14.824574 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-35905ae8-b0ee-422f-af1d-ff6b5497f902 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1464 microversion: 2.1 time: 0.162574 Sep 24 19:54:14.825135 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 549/1057] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:14 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:14.872173 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:14.872661 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:14.874659 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:54:14.880904 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:14.881395 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:14.881836 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:14.882543 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:14.883006 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:14.883455 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:14.910675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Going to try to terminate instance {{(pid=127046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:54:14.989174 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b355bbee-21ed-411d-9df4-513d190867d7 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "DELETE /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 204 len: 0 microversion: 2.1 time: 0.121155 Sep 24 19:54:14.993340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 509/1058] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:54:14 2022] DELETE /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:54:14.998742 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:14.999388 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:15.005424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:15.005909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:15.006345 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:15.007040 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:15.007562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:15.007992 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:15.139851 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:15.147507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d4a44ed9-f749-4886-96fe-434af756c2cb tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1470 microversion: 2.1 time: 0.152801 Sep 24 19:54:15.148066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 550/1059] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:14 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:16.171118 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:16.171853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:16.178212 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:16.178704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:16.179148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:16.179875 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:16.180342 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:16.180890 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:16.318955 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:16.327276 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4a0d74f1-6130-4c96-b53f-4f81d986b520 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1470 microversion: 2.1 time: 0.160712 Sep 24 19:54:16.327897 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 510/1060] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:16 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:17.350291 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:17.350836 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:17.357978 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:17.358460 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:17.358918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:17.359654 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:17.360139 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:17.360562 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:17.490805 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:17.498649 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-18d7a52e-4b34-4a7c-a5dd-16bfea2bfdf5 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1470 microversion: 2.1 time: 0.152372 Sep 24 19:54:17.499208 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 551/1061] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:17 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:18.521604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:18.522414 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:18.530116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:18.530717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:18.531170 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:18.532039 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:18.532543 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:18.532979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:18.668932 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8394b3206e4846cca84e9ba8a1c5baa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a689e57aa4fc8a6bc9adc4891188a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:54:18.677054 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-dd8e2bd2-61a7-4d61-87a2-178024ebfd0d tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 200 len: 1470 microversion: 2.1 time: 0.159361 Sep 24 19:54:18.691850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 511/1062] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:18 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:54:18.744861 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-646a0b7f-9783-4300-97e9-abce37573336 req-72792973-7c05-4e04-aadf-0360b814ce57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b723a04-55d8-42e5-ad5f-8d062f8581fd", "name": "network-vif-deleted", "tag": "7ef8cbd0-c902-4032-8bb0-359e88c170ca"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:54:18.756301 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-646a0b7f-9783-4300-97e9-abce37573336 req-72792973-7c05-4e04-aadf-0360b814ce57 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:18.756917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-646a0b7f-9783-4300-97e9-abce37573336 req-72792973-7c05-4e04-aadf-0360b814ce57 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:18.757631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-646a0b7f-9783-4300-97e9-abce37573336 req-72792973-7c05-4e04-aadf-0360b814ce57 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:18.770387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-646a0b7f-9783-4300-97e9-abce37573336 req-72792973-7c05-4e04-aadf-0360b814ce57 service nova] Creating event network-vif-deleted:7ef8cbd0-c902-4032-8bb0-359e88c170ca for instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd on hv-cinder-85919 Sep 24 19:54:18.778573 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-646a0b7f-9783-4300-97e9-abce37573336 req-72792973-7c05-4e04-aadf-0360b814ce57 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038506 Sep 24 19:54:18.779380 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 552/1063] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:54:19.701373 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:54:19.701920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] [instance: 5b723a04-55d8-42e5-ad5f-8d062f8581fd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:54:19.708604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:19.709094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:19.709533 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:19.710231 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:54:19.710713 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:54:19.711141 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:54:19.725391 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] HTTP exception thrown: Instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd could not be found. Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Request method failure captured: Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd HTTP/1.1 Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL2BZMQnK6zEo6Qb9cT4c9yHT5yl1qiOPDWjWAUDDJF1lvnfAlJ3NNmjAUgXF-WA__Nex-zN8if0m4ZX5Nu74NlGWGC1tyWGkH1RnGOz7y7XF6yaYVU5mmLjoGue07Cxw71_VBSjJ1BHmKiF-aOTy_n4XdCvR8OPPEDp3R69LyVHxCu0 Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: da4a689e57aa4fc8a6bc9adc4891188a Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-VolumesNegativeTest-210856258 Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 19:54:19.727261 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_da4a689e57aa4fc8a6bc9adc4891188a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/da4a689e57aa4fc8a6bc9adc4891188a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/da4a689e57aa4fc8a6bc9adc4891188a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/da4a689e57aa4fc8a6bc9adc4891188a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-VolumesNegativeTest-210856258 Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: da4a689e57aa4fc8a6bc9adc4891188a Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-VolumesNegativeTest-210856258 Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-VolumesNegativeTest-210856258-project Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 8394b3206e4846cca84e9ba8a1c5baa4 Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-VolumesNegativeTest-210856258-project Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd could not be found. Sep 24 19:54:19.730031 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '5b723a04-55d8-42e5-ad5f-8d062f8581fd'} Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd could not be found. Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:54:19.731041 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd could not be found. Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd could not be found. Sep 24 19:54:19.732675 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 19:54:19.734169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] Returning 404 to user: Instance 5b723a04-55d8-42e5-ad5f-8d062f8581fd could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:54:19.734169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-b6e4f06c-65cf-4183-bd2b-b9c1afc53cb3 tempest-VolumesNegativeTest-210856258 tempest-VolumesNegativeTest-210856258-project] 10.222.0.55 "GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd" status: 404 len: 111 microversion: 2.1 time: 0.032177 Sep 24 19:54:19.734169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 512/1064] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:54:19 2022] GET /compute/v2.1/servers/5b723a04-55d8-42e5-ad5f-8d062f8581fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 19:56:02.092026 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:02.092818 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=78 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:02.093940 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 19:56:02.094147 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Sat Sep 24 19:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 (ip 10.222.0.55) !!! Sep 24 19:56:02.099507 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:02.100137 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:02.111830 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:02.112316 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:02.112755 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:02.113461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:02.113920 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:02.114352 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:02.142054 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 19:56:02.221098 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-623dbebe-6287-49dc-a769-522a6dca427c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 204 len: 0 microversion: 2.1 time: 0.130840 Sep 24 19:56:02.221985 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 553/1065] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 19:56:02 2022] DELETE /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 19:56:02.230472 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fd7a3a77-26b9-4b3e-87cd-0d00d89534dd] AMQP server on 10.222.0.55:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 24 19:56:02.231130 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:02.231890 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:02.233457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 19:56:02.233654 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Sat Sep 24 19:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 (ip 10.222.0.55) !!! Sep 24 19:56:02.235738 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 19:56:02.235872 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Sat Sep 24 19:56:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 (ip 10.222.0.55) !!! Sep 24 19:56:02.241394 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:02.242012 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:02.260608 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:02.261104 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:02.261584 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:02.262297 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:02.262758 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:02.263183 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:02.506848 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:02.514676 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-cd9bb431-bf65-4b00-a04a-cb6a0b94ada2 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1579 microversion: 2.1 time: 0.287682 Sep 24 19:56:02.515232 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 513/1066] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:02 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1579 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:03.539541 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:03.540252 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:03.547496 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:03.547995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:03.548436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:03.549162 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:03.549609 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:03.550035 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:03.737692 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:03.746078 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-05011ad7-ae8f-4cf8-ad76-e206652e5c0f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1579 microversion: 2.1 time: 0.211751 Sep 24 19:56:03.746637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 554/1067] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:03 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:04.768534 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:04.769163 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:04.778134 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:04.778643 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:04.779096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:04.779850 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:04.780319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:04.780756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:04.788081 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO oslo.messaging._drivers.impl_rabbit [-] [fd7a3a77-26b9-4b3e-87cd-0d00d89534dd] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 41310. Sep 24 19:56:04.854248 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:04.863920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-18297cc6-4757-436e-8284-1f9cba7fe270 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1511 microversion: 2.1 time: 0.099292 Sep 24 19:56:04.864497 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 514/1068] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:04 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:05.406512 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-9e3b6ec2-e263-45e0-ad38-17b2946cc755 req-6043aa4b-8725-40f6-b7ac-bc1fe4c8c162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d1c0336-0f9c-4109-b44d-72fc095fed33", "name": "network-vif-deleted", "tag": "e10b4fe8-b11f-4dac-bed1-078a2684853b"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:56:05.420655 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-9e3b6ec2-e263-45e0-ad38-17b2946cc755 req-6043aa4b-8725-40f6-b7ac-bc1fe4c8c162 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:05.421157 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-9e3b6ec2-e263-45e0-ad38-17b2946cc755 req-6043aa4b-8725-40f6-b7ac-bc1fe4c8c162 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:05.422056 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-9e3b6ec2-e263-45e0-ad38-17b2946cc755 req-6043aa4b-8725-40f6-b7ac-bc1fe4c8c162 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:05.436675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-9e3b6ec2-e263-45e0-ad38-17b2946cc755 req-6043aa4b-8725-40f6-b7ac-bc1fe4c8c162 service nova] Creating event network-vif-deleted:e10b4fe8-b11f-4dac-bed1-078a2684853b for instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 on hv-cinder-85919 Sep 24 19:56:05.442603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-9e3b6ec2-e263-45e0-ad38-17b2946cc755 req-6043aa4b-8725-40f6-b7ac-bc1fe4c8c162 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110785 Sep 24 19:56:05.443277 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 555/1069] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:56:05.887866 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:05.889225 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:05.897704 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:05.901100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:05.901756 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:05.902494 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:05.902958 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:05.903384 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:05.938800 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:05.939298 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:05.939794 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:05.940249 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.objects.instance [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lazy-loading 'fault' on Instance uuid 3d1c0336-0f9c-4109-b44d-72fc095fed33 {{(pid=127046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 19:56:05.984044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:05.992525 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f4e8afa9-1c1e-466a-999f-6659820d82b5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 200 len: 1231 microversion: 2.1 time: 0.108861 Sep 24 19:56:05.993092 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 515/1070] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:05 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:07.016744 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:07.017361 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:07.024461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:07.024951 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:07.025395 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:07.026095 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:07.026564 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:07.026995 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:07.041215 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] HTTP exception thrown: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Request method failure captured: Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 HTTP/1.1 Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL2Ai7uDBlfTWLDns2LFOdOIjTnaS8Fb6aq__Dd_MLO8MSQjWD4jJjazsmMOmV_SEfyjwnb3hJyMB9-srBFMmvyWRztECWVt0qX2QwMG2iDO-SaK9dNJXUXC8NHfAziDgmrIwCx-2h-GGkKUE3mE4cmVlJyNQnRFfJViSbHGmMLImj_M Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: d308ae5684724251aa1011f269cf466a Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 19:56:07.042884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d308ae5684724251aa1011f269cf466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d308ae5684724251aa1011f269cf466a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-TestVolumeBootPattern-1939414081 Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: d308ae5684724251aa1011f269cf466a Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-TestVolumeBootPattern-1939414081-project Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 94533495d9ea4e489e7283dbf307ae66 Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-TestVolumeBootPattern-1939414081-project Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 19:56:07.044707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '3d1c0336-0f9c-4109-b44d-72fc095fed33'} Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 19:56:07.046119 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 19:56:07.047872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 19:56:07.049353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Returning 404 to user: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 19:56:07.049353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-f600de7b-8445-4477-823d-6d02e309b4eb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 404 len: 111 microversion: 2.1 time: 0.032406 Sep 24 19:56:07.049353 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 556/1071] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:07 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 19:56:07.152976 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1131499034", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1412825204", "security_groups": [{"name": "tempest-secgroup-smoke-1849033028"}], "block_device_mapping_v2": [{"uuid": "7d35f454-d345-4a75-a74a-c50ae3dcf777", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "687c9eeb-bbdd-4f20-9be2-93d6692b6d9b"}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:56:07.284571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] validate_networks() for [('687c9eeb-bbdd-4f20-9be2-93d6692b6d9b', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:56:07.708483 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:56:07.708912 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:56:07.709430 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:56:07.709894 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:56:07.710302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:56:07.719139 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:07.719657 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:07.720094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:07.720820 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:07.721276 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:07.721702 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:07.738099 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for project d308ae5684724251aa1011f269cf466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:56:07.742541 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for user 94533495d9ea4e489e7283dbf307ae66 and project d308ae5684724251aa1011f269cf466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:56:07.798638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:56:07.800796 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d35f454-d345-4a75-a74a-c50ae3dcf777',volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:56:07.937247 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-85892762-3c6c-41f6-946e-56f1e2de4058 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788596 Sep 24 19:56:07.937896 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 516/1072] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:56:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 19:56:07.949082 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-12e45b7a-b398-47d3-bfe4-e8dd4e338a8e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:07.949709 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-12e45b7a-b398-47d3-bfe4-e8dd4e338a8e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:08.003377 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-12e45b7a-b398-47d3-bfe4-e8dd4e338a8e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:08.010302 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-12e45b7a-b398-47d3-bfe4-e8dd4e338a8e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1095 microversion: 2.1 time: 0.065123 Sep 24 19:56:08.010873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 557/1073] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:07 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:09.033697 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-95ce7608-a0a5-40f6-b267-faf258cf3021 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:09.034301 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-95ce7608-a0a5-40f6-b267-faf258cf3021 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:09.088420 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-95ce7608-a0a5-40f6-b267-faf258cf3021 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:09.095450 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-95ce7608-a0a5-40f6-b267-faf258cf3021 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1095 microversion: 2.1 time: 0.066125 Sep 24 19:56:09.096053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 517/1074] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:09 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:10.119610 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-efcda49b-f9b4-4b95-a2fa-feb11dd8bd77 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:10.120236 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-efcda49b-f9b4-4b95-a2fa-feb11dd8bd77 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:10.179972 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-efcda49b-f9b4-4b95-a2fa-feb11dd8bd77 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:10.187336 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-efcda49b-f9b4-4b95-a2fa-feb11dd8bd77 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1095 microversion: 2.1 time: 0.072409 Sep 24 19:56:10.187934 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 558/1075] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:10 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:11.210213 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-425b14a6-d66e-4f6b-a8ce-38fafcb37327 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:11.210828 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-425b14a6-d66e-4f6b-a8ce-38fafcb37327 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:11.263254 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-425b14a6-d66e-4f6b-a8ce-38fafcb37327 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:11.270581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-425b14a6-d66e-4f6b-a8ce-38fafcb37327 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1095 microversion: 2.1 time: 0.064286 Sep 24 19:56:11.271162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 518/1076] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:11 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:12.296932 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:12.297571 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:12.304787 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:12.305270 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:12.305710 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:12.306404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:12.306865 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:12.307298 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:12.369574 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:12.377288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-d73818de-4cf5-4956-881e-c713b8270ce7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1145 microversion: 2.1 time: 0.084472 Sep 24 19:56:12.377855 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 559/1077] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:12 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:13.400599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:13.401221 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:13.407499 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:13.408091 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:13.408428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:13.409150 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:13.409618 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:13.410048 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:13.476036 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:13.484165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-13e206e2-e051-4ea1-bb6a-b7d648bcad00 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1211 microversion: 2.1 time: 0.087421 Sep 24 19:56:13.484748 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 519/1078] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:13 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:14.508970 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:14.509658 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:14.516457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:14.516764 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:14.517212 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:14.517927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:14.518432 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:14.518868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:14.724352 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:14.732678 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-764ba1a4-0bec-4a85-a6c1-021b111c51c9 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.228025 Sep 24 19:56:14.733693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 560/1079] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:14 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:14.836656 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-9528ae9c-3eb6-482e-ad5d-a1995a94c24a req-bfea825a-9e0d-4c4c-b3dc-e375f09872a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a26ea2-2640-4b3b-90e5-12b4496a9dbd", "tag": "6af177a2-0d33-4754-a4cf-54505ac5dc26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:56:14.847868 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9528ae9c-3eb6-482e-ad5d-a1995a94c24a req-bfea825a-9e0d-4c4c-b3dc-e375f09872a5 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:14.848451 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9528ae9c-3eb6-482e-ad5d-a1995a94c24a req-bfea825a-9e0d-4c4c-b3dc-e375f09872a5 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:14.848960 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-9528ae9c-3eb6-482e-ad5d-a1995a94c24a req-bfea825a-9e0d-4c4c-b3dc-e375f09872a5 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:14.861515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-9528ae9c-3eb6-482e-ad5d-a1995a94c24a req-bfea825a-9e0d-4c4c-b3dc-e375f09872a5 service nova] Creating event network-changed:6af177a2-0d33-4754-a4cf-54505ac5dc26 for instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd on hv-cinder-85919 Sep 24 19:56:14.867088 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-9528ae9c-3eb6-482e-ad5d-a1995a94c24a req-bfea825a-9e0d-4c4c-b3dc-e375f09872a5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034901 Sep 24 19:56:14.867734 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 520/1080] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:56:15.755736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:15.756579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:15.763262 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:15.763791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:15.764235 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:15.764953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:15.765418 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:15.765862 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:15.975663 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:15.984110 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-68f0f5fc-e484-44e6-9b2a-678c76f2cc8d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.232308 Sep 24 19:56:15.984702 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 561/1081] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:15 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:17.008024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:17.008637 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:17.015086 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:17.015602 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:17.016064 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:17.016758 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:17.017216 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:17.017644 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:17.150054 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:17.157813 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-4775298a-eb1a-4a64-8f5a-efb34f6311b3 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.155294 Sep 24 19:56:17.158378 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 521/1082] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:17 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:18.182042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:18.182675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:18.189029 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:18.189519 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:18.189953 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:18.190646 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:18.191102 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:18.191560 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:18.322579 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:18.330449 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1fe95cf2-ca65-4dda-8155-3be6121b620f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.152858 Sep 24 19:56:18.331008 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 562/1083] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:18 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:19.353489 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:19.354037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:19.356008 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:19.361879 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:19.362374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:19.362816 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:19.363582 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:19.364052 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:19.364485 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:19.493454 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:19.501186 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-ca210f37-bf3b-447b-a2f5-9f5c66df2af0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.152196 Sep 24 19:56:19.501746 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 522/1084] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:19 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:20.524369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:20.525015 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:20.527121 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=4 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:20.532771 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:20.533269 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:20.533708 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:20.534410 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:20.534893 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:20.535306 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:20.673245 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:20.681726 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-ae0abb08-c81d-4584-abfd-1df35e09cc2d tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.161734 Sep 24 19:56:20.682304 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 563/1085] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:20 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:21.705094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:21.705710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:21.708067 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=10 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:56:21.714264 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:21.714761 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:21.715200 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:21.715937 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:21.716402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:21.716834 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:21.861468 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:21.869853 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5b89198a-84f7-41f3-b235-f0a259a6eafb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.168677 Sep 24 19:56:21.870422 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 523/1086] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:21 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:22.893482 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:22.894079 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:22.901386 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:22.902465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:22.902465 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:22.903017 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:22.903461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:22.903913 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:23.039943 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:23.048102 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-65f238ee-186e-45b3-a8e2-7686fb3a2e35 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.158590 Sep 24 19:56:23.048691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 564/1087] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:22 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:24.070302 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:24.070930 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:24.077581 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:24.078106 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:24.078532 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:24.079608 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:24.080077 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:24.080515 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:24.214995 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:24.222920 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-51247e2d-4ac1-4c1c-9991-528197dd1b74 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.156485 Sep 24 19:56:24.223408 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 524/1088] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:24 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:25.246774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:25.247413 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:25.253837 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:25.254324 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:25.254763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:25.255485 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:25.256042 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:25.256500 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:25.391866 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:25.400094 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-9a0a34a0-65a1-4849-b3b2-820f2a006072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.157166 Sep 24 19:56:25.400654 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 565/1089] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:25 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:26.423935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:26.424584 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:26.432255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:26.432755 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:26.433206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:26.433929 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:26.434398 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:26.434833 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:26.569752 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:26.579082 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-e61e96f7-3708-4a6e-8324-228469743e36 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.159245 Sep 24 19:56:26.579694 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 525/1090] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:26 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:27.212843 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-ad31ffbd-cbce-4744-bb37-4128f674692e req-b4638dea-07b0-4eff-9471-efc9893372db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a26ea2-2640-4b3b-90e5-12b4496a9dbd", "name": "network-vif-plugged", "status": "completed", "tag": "6af177a2-0d33-4754-a4cf-54505ac5dc26"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:56:27.222921 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ad31ffbd-cbce-4744-bb37-4128f674692e req-b4638dea-07b0-4eff-9471-efc9893372db service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:27.223439 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ad31ffbd-cbce-4744-bb37-4128f674692e req-b4638dea-07b0-4eff-9471-efc9893372db service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:27.223918 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-ad31ffbd-cbce-4744-bb37-4128f674692e req-b4638dea-07b0-4eff-9471-efc9893372db service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:27.237917 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-ad31ffbd-cbce-4744-bb37-4128f674692e req-b4638dea-07b0-4eff-9471-efc9893372db service nova] Creating event network-vif-plugged:6af177a2-0d33-4754-a4cf-54505ac5dc26 for instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd on hv-cinder-85919 Sep 24 19:56:27.242871 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-ad31ffbd-cbce-4744-bb37-4128f674692e req-b4638dea-07b0-4eff-9471-efc9893372db service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095271 Sep 24 19:56:27.243501 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 566/1091] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:56:27.602770 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:27.603419 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:27.610005 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:27.610504 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:27.610946 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:27.611689 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:27.612149 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:27.612574 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:27.745905 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:27.753752 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-07d5fb03-08de-4348-8b18-dd5d491cfeeb tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1267 microversion: 2.1 time: 0.155382 Sep 24 19:56:27.754319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 526/1092] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:27 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:28.778387 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:28.779094 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:28.785506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:28.786009 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:28.786474 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:28.787183 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:28.788668 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:28.789105 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:28.939637 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:28.948700 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-df4735b4-13a8-4b67-be58-477f47430aff tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1455 microversion: 2.1 time: 0.175005 Sep 24 19:56:28.949288 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 567/1093] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:28 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:28.971824 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:56:28.972442 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:56:28.979220 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:28.979819 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:28.980260 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:28.980967 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:28.981428 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:28.981854 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:29.141299 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:56:29.153142 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-07b88fa9-1e64-4371-9fba-c6f8544bef84 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1455 microversion: 2.1 time: 0.184843 Sep 24 19:56:29.154190 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 527/1094] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:56:28 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1455 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:56:31.106126 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-1fed7eab-2708-48e3-9b02-686b926190ad req-4e6ea88c-7703-419e-97eb-a1cb8884fe04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a26ea2-2640-4b3b-90e5-12b4496a9dbd", "tag": "6af177a2-0d33-4754-a4cf-54505ac5dc26"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:56:31.116707 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-1fed7eab-2708-48e3-9b02-686b926190ad req-4e6ea88c-7703-419e-97eb-a1cb8884fe04 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:56:31.117404 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-1fed7eab-2708-48e3-9b02-686b926190ad req-4e6ea88c-7703-419e-97eb-a1cb8884fe04 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:56:31.117938 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-1fed7eab-2708-48e3-9b02-686b926190ad req-4e6ea88c-7703-419e-97eb-a1cb8884fe04 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:56:31.129193 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-1fed7eab-2708-48e3-9b02-686b926190ad req-4e6ea88c-7703-419e-97eb-a1cb8884fe04 service nova] Creating event network-changed:6af177a2-0d33-4754-a4cf-54505ac5dc26 for instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd on hv-cinder-85919 Sep 24 19:56:31.134797 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-1fed7eab-2708-48e3-9b02-686b926190ad req-4e6ea88c-7703-419e-97eb-a1cb8884fe04 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032526 Sep 24 19:56:31.135486 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 568/1095] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:58:17.112791 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:17.113539 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=72 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:17.119024 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1545028466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1412825204", "security_groups": [{"name": "tempest-secgroup-smoke-1849033028"}], "block_device_mapping_v2": [{"uuid": "e154b10d-23a3-405e-b195-1cb08ef664c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "687c9eeb-bbdd-4f20-9be2-93d6692b6d9b"}]}} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:58:17.235809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.network.neutron [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] validate_networks() for [('687c9eeb-bbdd-4f20-9be2-93d6692b6d9b', None, None, None, None, None)] {{(pid=127046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 19:58:17.608638 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Flavor limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 19:58:17.609356 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Image limits 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 19:58:17.609874 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Flavor pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 19:58:17.610315 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Image pref 0:0:0 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 19:58:17.610729 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.virt.hardware [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 19:58:17.619516 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:17.620001 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:17.620438 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:17.621162 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:17.621615 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:17.622037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:17.638664 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for project d308ae5684724251aa1011f269cf466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 19:58:17.643069 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.quota [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Getting quotas for user 94533495d9ea4e489e7283dbf307ae66 and project d308ae5684724251aa1011f269cf466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 19:58:17.706724 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Going to run 1 instances... {{(pid=127046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 19:58:17.710014 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e154b10d-23a3-405e-b195-1cb08ef664c8',volume_size=None,volume_type=None)] {{(pid=127046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 19:58:17.855733 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-1d9e72e4-2a34-4a1c-9eef-84db429d1657 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744566 Sep 24 19:58:17.856400 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 528/1096] 10.222.0.55 () {60 vars in 1147 bytes} [Sat Sep 24 19:58:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 19:58:17.866424 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:17.867179 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:17.868093 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 19:58:17.868289 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Sat Sep 24 19:58:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 (ip 10.222.0.55) !!! Sep 24 19:58:17.882569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6bd0ef33-24a5-4311-88b1-139555889050 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:17.883298 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6bd0ef33-24a5-4311-88b1-139555889050 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:17.945868 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6bd0ef33-24a5-4311-88b1-139555889050 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:17.956096 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6bd0ef33-24a5-4311-88b1-139555889050 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1095 microversion: 2.1 time: 0.091719 Sep 24 19:58:17.956654 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 569/1097] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:17 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1095 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:18.979524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:18.980133 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:18.986914 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:18.987404 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:18.987865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:18.988557 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:18.989017 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:18.989446 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:19.050357 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:19.058046 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-01dc2567-feab-43eb-85c4-48da7224bc8c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1193 microversion: 2.1 time: 0.083043 Sep 24 19:58:19.058602 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 529/1098] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:18 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:20.088390 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:20.088992 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:20.096034 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:20.096529 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:20.096967 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:20.097669 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:20.098129 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:20.098561 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:20.169156 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:20.177962 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-7d62de51-0090-4d3d-857f-d4ff80388780 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1211 microversion: 2.1 time: 0.093595 Sep 24 19:58:20.178896 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 570/1099] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:20 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:21.203019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:21.203835 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:21.210684 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:21.211233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:21.211725 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:21.212628 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:21.213063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:21.213477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:21.286202 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-27a79fba-e0f7-4437-83b8-86cc0627d417 req-7d278e28-2e3e-4a88-a983-d084aa59daae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa0ea07-e064-40ad-a467-50716e11f6a2", "tag": "c2858d7d-b188-4ee2-ae20-1ee667053f49"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:58:21.300761 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-27a79fba-e0f7-4437-83b8-86cc0627d417 req-7d278e28-2e3e-4a88-a983-d084aa59daae service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:21.300909 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-27a79fba-e0f7-4437-83b8-86cc0627d417 req-7d278e28-2e3e-4a88-a983-d084aa59daae service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:21.302340 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-27a79fba-e0f7-4437-83b8-86cc0627d417 req-7d278e28-2e3e-4a88-a983-d084aa59daae service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:21.315877 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-27a79fba-e0f7-4437-83b8-86cc0627d417 req-7d278e28-2e3e-4a88-a983-d084aa59daae service nova] Creating event network-changed:c2858d7d-b188-4ee2-ae20-1ee667053f49 for instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 on hv-cinder-85919 Sep 24 19:58:21.330790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-27a79fba-e0f7-4437-83b8-86cc0627d417 req-7d278e28-2e3e-4a88-a983-d084aa59daae service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051697 Sep 24 19:58:21.334790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 571/1100] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 19:58:21.358852 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:21.367282 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d6723a98-819f-4d8f-a133-47f03515da26 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.168913 Sep 24 19:58:21.367974 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 530/1101] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:21 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:22.390971 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:22.391722 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:22.398532 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:22.399073 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:22.399493 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:22.400211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:22.400704 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:22.401141 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:22.611880 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:22.619674 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6f5ae756-a821-468d-8eb8-b61ec4fc60ae tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.233016 Sep 24 19:58:22.620550 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 572/1102] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:22 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:23.642925 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:23.643571 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:23.650010 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:23.650495 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:23.650935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:23.651666 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:23.652148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:23.652556 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:23.794542 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:23.804165 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d27038ed-52fc-4964-bd1d-558acf5c8ce5 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.164550 Sep 24 19:58:23.804918 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 531/1103] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:23 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:24.826291 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:24.826904 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:24.834080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:24.834569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:24.835007 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:24.835736 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:24.836195 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:24.836621 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:24.966730 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:24.974952 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-876edcbf-7b53-4d9c-81b2-0097a97e6e1c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.152519 Sep 24 19:58:24.975533 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 573/1104] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:24 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:25.998507 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:25.999615 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:26.006096 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:26.006586 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:26.007068 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:26.007766 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:26.008230 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:26.008658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:26.146268 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:26.154246 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d2b43af7-5f03-4023-9981-aa3805d418bf tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.159738 Sep 24 19:58:26.154829 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 532/1105] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:25 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:27.177569 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:27.178186 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:27.184778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:27.185263 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:27.185698 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:27.186781 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:27.187259 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:27.187724 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:27.322619 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:27.330977 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-519839f7-ff42-491f-b5ff-a0aad1498c43 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.157412 Sep 24 19:58:27.331557 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 574/1106] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:27 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:28.354602 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:28.355206 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:28.357616 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=2 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:28.358317 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell0:SELECT=6 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:28.364368 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:28.364865 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:28.365309 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:28.366019 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:28.366481 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:28.366913 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:28.522710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:28.530950 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3336b5f5-48b1-492c-a0e5-6d55a1b54fab tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.180129 Sep 24 19:58:28.531567 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 533/1107] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:28 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:29.554798 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:29.555778 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:29.558211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell0:SELECT=2 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:58:29.565149 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:29.566066 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:29.566610 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:29.567539 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:29.568383 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:29.568819 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:29.711759 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:29.722659 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6810c9c2-b8fe-4a59-a82c-f29b5d9ccda8 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.171671 Sep 24 19:58:29.723506 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 575/1108] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:29 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:30.746063 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:30.746629 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:30.753549 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:30.754039 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:30.754477 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:30.755169 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:30.755668 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:30.756094 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:30.890795 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:30.898671 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-2e95eef6-8fc9-4136-a51b-ae52dfb9cde0 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.156979 Sep 24 19:58:30.899248 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 534/1109] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:30 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:31.758763 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-22e69739-a6de-493e-ab24-af2bd140e060 req-00ff418a-e559-4060-a44e-4dadd30f3e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa0ea07-e064-40ad-a467-50716e11f6a2", "name": "network-vif-plugged", "status": "completed", "tag": "c2858d7d-b188-4ee2-ae20-1ee667053f49"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:58:31.768954 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-22e69739-a6de-493e-ab24-af2bd140e060 req-00ff418a-e559-4060-a44e-4dadd30f3e1e service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:31.769458 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-22e69739-a6de-493e-ab24-af2bd140e060 req-00ff418a-e559-4060-a44e-4dadd30f3e1e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:31.769892 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-22e69739-a6de-493e-ab24-af2bd140e060 req-00ff418a-e559-4060-a44e-4dadd30f3e1e service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:31.781138 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-22e69739-a6de-493e-ab24-af2bd140e060 req-00ff418a-e559-4060-a44e-4dadd30f3e1e service nova] Creating event network-vif-plugged:c2858d7d-b188-4ee2-ae20-1ee667053f49 for instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 on hv-cinder-85919 Sep 24 19:58:31.786061 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-22e69739-a6de-493e-ab24-af2bd140e060 req-00ff418a-e559-4060-a44e-4dadd30f3e1e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031214 Sep 24 19:58:31.786652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 576/1110] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 19:58:31.921780 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:31.922424 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:31.929087 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:31.929597 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:31.930032 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:31.930743 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:31.931213 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:31.931678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:32.068297 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:32.076551 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-9d6e87c2-956f-45c7-a033-d40c907b28f7 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.159536 Sep 24 19:58:32.077156 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 535/1111] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:31 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:33.100060 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:33.100769 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:33.107211 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:33.107738 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:33.108806 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:33.109873 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:33.110344 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:33.110782 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:33.253552 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:33.262718 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-b88f4769-aa73-4e2c-9456-9c5bb6c3609a tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1267 microversion: 2.1 time: 0.167352 Sep 24 19:58:33.263306 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 577/1112] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:33 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:34.286044 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:34.286673 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:34.293161 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:34.293658 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:34.294098 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:34.294812 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:34.295277 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:34.295996 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:34.440555 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:34.448610 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-5d8d0b1b-bf48-4b15-a697-6b876a282564 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1455 microversion: 2.1 time: 0.166518 Sep 24 19:58:34.449187 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 536/1113] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:34 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1455 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 19:58:34.471185 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 19:58:34.471842 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 19:58:34.478265 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:34.478746 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:34.479177 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:34.479911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:34.480369 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:34.480793 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:34.614461 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 19:58:34.622524 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-de909e11-0a44-4459-ae59-6f0861929b23 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1455 microversion: 2.1 time: 0.154995 Sep 24 19:58:34.623097 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 578/1114] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 19:58:34 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 19:58:36.289116 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa0ea07-e064-40ad-a467-50716e11f6a2", "tag": "c2858d7d-b188-4ee2-ae20-1ee667053f49"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 19:58:36.299787 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 19:58:36.300280 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 19:58:36.300717 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 19:58:36.312667 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] Creating event network-changed:c2858d7d-b188-4ee2-ae20-1ee667053f49 for instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 on hv-cinder-85919 Sep 24 19:58:36.316195 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR oslo.messaging._drivers.impl_rabbit [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] [67a0b7fb-ec42-4925-95fb-9351adfe49cc] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 19:58:37.324075 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO oslo.messaging._drivers.impl_rabbit [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] [67a0b7fb-ec42-4925-95fb-9351adfe49cc] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 41544. Sep 24 19:58:37.327902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-aa06d851-1b44-4ee6-8d05-7f5ccf09a030 req-f7228c01-ad8a-4f78-991a-3decf93752a4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.103686 Sep 24 19:58:37.328513 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 537/1115] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 19:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:00:05.741586 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:05.742490 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:05.749718 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:05.750974 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG dbcounter [-] [127046] Writing DB stats nova_cell1:SELECT=52 {{(pid=127046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:05.752497 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 20:00:05.752710 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Sat Sep 24 20:00:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.55) !!! Sep 24 20:00:05.764765 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_api:SELECT=22 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:05.765906 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG dbcounter [-] [127045] Writing DB stats nova_cell1:SELECT=46 {{(pid=127045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:00:05.766554 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-67b784d2-6522-411c-8bfe-2b0d7fd1ee85 req-d97d51e8-c50c-4b32-9410-db85aad9a879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa0ea07-e064-40ad-a467-50716e11f6a2", "tag": "c2858d7d-b188-4ee2-ae20-1ee667053f49"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:00:05.768497 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 20:00:05.768717 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Sat Sep 24 20:00:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 (ip 10.222.0.55) !!! Sep 24 20:00:05.791455 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:05.792482 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:05.794774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:05.796376 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:05.797272 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:05.797990 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:05.798541 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-67b784d2-6522-411c-8bfe-2b0d7fd1ee85 req-d97d51e8-c50c-4b32-9410-db85aad9a879 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:05.800977 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-67b784d2-6522-411c-8bfe-2b0d7fd1ee85 req-d97d51e8-c50c-4b32-9410-db85aad9a879 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:05.801496 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-67b784d2-6522-411c-8bfe-2b0d7fd1ee85 req-d97d51e8-c50c-4b32-9410-db85aad9a879 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:05.824148 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-67b784d2-6522-411c-8bfe-2b0d7fd1ee85 req-d97d51e8-c50c-4b32-9410-db85aad9a879 service nova] Creating event network-changed:c2858d7d-b188-4ee2-ae20-1ee667053f49 for instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 on hv-cinder-85919 Sep 24 20:00:05.833521 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-67b784d2-6522-411c-8bfe-2b0d7fd1ee85 req-d97d51e8-c50c-4b32-9410-db85aad9a879 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087497 Sep 24 20:00:05.834558 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 538/1116] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 20:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:00:05.836257 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:00:05.936731 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-4f3fad10-e2ae-4dd9-a46a-5f02a1143d95 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 204 len: 0 microversion: 2.1 time: 0.202235 Sep 24 20:00:05.942516 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 579/1117] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 20:00:05 2022] DELETE /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:00:05.956547 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:05.959779 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:05.973137 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:05.974029 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:05.974840 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:05.976100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:05.977146 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:05.978281 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:06.189406 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:00:06.198917 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-6be50cc7-0c25-4066-8591-1b8029d0f43c tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1579 microversion: 2.1 time: 0.253556 Sep 24 20:00:06.200808 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 539/1118] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:05 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1579 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:00:07.229774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:07.230426 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:07.238675 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:07.239205 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:07.239691 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:07.240446 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:07.240919 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:07.241356 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:07.477278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:00:07.491880 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-2c92ead1-d161-4915-851b-1f26b714002e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1579 microversion: 2.1 time: 0.267958 Sep 24 20:00:07.492830 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 580/1119] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:07 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1579 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:00:08.535902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:08.537022 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:08.540164 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [req-cdda516f-f313-4a0d-9f33-89a28400c33a req-971af819-1b33-4e9f-bcd4-f3c39d9d0980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa0ea07-e064-40ad-a467-50716e11f6a2", "name": "network-vif-deleted", "tag": "c2858d7d-b188-4ee2-ae20-1ee667053f49"}]} {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:00:08.548971 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:08.549692 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:08.550304 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:08.550872 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-cdda516f-f313-4a0d-9f33-89a28400c33a req-971af819-1b33-4e9f-bcd4-f3c39d9d0980 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:08.551374 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:08.551639 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-cdda516f-f313-4a0d-9f33-89a28400c33a req-971af819-1b33-4e9f-bcd4-f3c39d9d0980 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:08.551887 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:08.552091 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [req-cdda516f-f313-4a0d-9f33-89a28400c33a req-971af819-1b33-4e9f-bcd4-f3c39d9d0980 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:08.552274 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:08.564869 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.compute.server_external_events [req-cdda516f-f313-4a0d-9f33-89a28400c33a req-971af819-1b33-4e9f-bcd4-f3c39d9d0980 service nova] Creating event network-vif-deleted:c2858d7d-b188-4ee2-ae20-1ee667053f49 for instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 on hv-cinder-85919 Sep 24 20:00:08.569976 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [req-cdda516f-f313-4a0d-9f33-89a28400c33a req-971af819-1b33-4e9f-bcd4-f3c39d9d0980 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Sep 24 20:00:08.570884 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 581/1120] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 20:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 20:00:08.627902 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:00:08.637360 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-85a92953-57c3-4fc7-8631-a7acf06b88a6 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1393 microversion: 2.1 time: 0.109370 Sep 24 20:00:08.638233 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 540/1121] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:08 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1393 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:00:09.664848 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:09.665572 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:09.672603 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:09.673107 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:09.673558 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:09.674355 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:09.675457 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:09.675911 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:09.711001 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:09.711527 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:09.711973 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:09.712436 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.objects.instance [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lazy-loading 'fault' on Instance uuid 2fa0ea07-e064-40ad-a467-50716e11f6a2 {{(pid=127045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 20:00:09.757649 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:00:09.765547 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-1cdcc6c1-da2f-4b4d-a05a-5b585daf0f4e tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 200 len: 1185 microversion: 2.1 time: 0.107155 Sep 24 20:00:09.766131 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 582/1122] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:09 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 1185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:00:10.790393 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:10.791018 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 2fa0ea07-e064-40ad-a467-50716e11f6a2] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:10.798053 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:10.798540 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:10.798979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:10.799709 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:10.800168 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:10.800596 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:10.814955 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] HTTP exception thrown: Instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 could not be found. Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Request method failure captured: Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 HTTP/1.1 Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL2Ai7uDBlfTWLDns2LFOdOIjTnaS8Fb6aq__Dd_MLO8MSQjWD4jJjazsmMOmV_SEfyjwnb3hJyMB9-srBFMmvyWRztECWVt0qX2QwMG2iDO-SaK9dNJXUXC8NHfAziDgmrIwCx-2h-GGkKUE3mE4cmVlJyNQnRFfJViSbHGmMLImj_M Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 20:00:10.816682 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d308ae5684724251aa1011f269cf466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d308ae5684724251aa1011f269cf466a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 94533495d9ea4e489e7283dbf307ae66 Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 could not be found. Sep 24 20:00:10.818448 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '2fa0ea07-e064-40ad-a467-50716e11f6a2'} Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 could not be found. Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:00:10.819747 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 could not be found. Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 could not be found. Sep 24 20:00:10.821457 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:10.822991 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Returning 404 to user: Instance 2fa0ea07-e064-40ad-a467-50716e11f6a2 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:00:10.822991 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-f850cdac-0ec6-4c87-ab5f-c9306f3bb993 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2" status: 404 len: 111 microversion: 2.1 time: 0.031660 Sep 24 20:00:10.822991 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 541/1123] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:10 2022] GET /compute/v2.1/servers/2fa0ea07-e064-40ad-a467-50716e11f6a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:00:13.973899 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:13.974790 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:13.979497 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-a55d1453-4fcf-4af9-bed7-9ebd36ece015 req-841a2bc4-f329-44a1-b627-8f0997e87a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a26ea2-2640-4b3b-90e5-12b4496a9dbd", "tag": "6af177a2-0d33-4754-a4cf-54505ac5dc26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:00:13.983346 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:13.984388 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:13.984994 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:13.986156 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:13.986946 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:13.987986 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:13.998599 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a55d1453-4fcf-4af9-bed7-9ebd36ece015 req-841a2bc4-f329-44a1-b627-8f0997e87a84 service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:13.999527 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a55d1453-4fcf-4af9-bed7-9ebd36ece015 req-841a2bc4-f329-44a1-b627-8f0997e87a84 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:14.000362 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-a55d1453-4fcf-4af9-bed7-9ebd36ece015 req-841a2bc4-f329-44a1-b627-8f0997e87a84 service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:14.017796 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Going to try to terminate instance {{(pid=127045) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 20:00:14.022255 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-a55d1453-4fcf-4af9-bed7-9ebd36ece015 req-841a2bc4-f329-44a1-b627-8f0997e87a84 service nova] Creating event network-changed:6af177a2-0d33-4754-a4cf-54505ac5dc26 for instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd on hv-cinder-85919 Sep 24 20:00:14.031150 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-a55d1453-4fcf-4af9-bed7-9ebd36ece015 req-841a2bc4-f329-44a1-b627-8f0997e87a84 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058708 Sep 24 20:00:14.032238 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 542/1124] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 20:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:00:14.141889 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-6cffbc06-5829-45e7-8d23-3d4e50367c62 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "DELETE /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 204 len: 0 microversion: 2.1 time: 0.173067 Sep 24 20:00:14.147558 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 583/1125] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 20:00:13 2022] DELETE /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 20:00:14.160979 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:14.163538 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:14.179838 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:14.180625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:14.182523 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:14.185783 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:14.186677 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:14.187478 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:14.379578 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.policy [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:00:14.392940 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-3f0deae6-dab1-4338-89f4-a5318b71870f tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1579 microversion: 2.1 time: 0.242697 Sep 24 20:00:14.393678 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 543/1126] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:14 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1579 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:00:15.420631 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:15.421604 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:15.430439 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:15.431323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:15.432163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:15.433475 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:15.435665 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:15.436488 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:15.595197 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:00:15.603561 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-5094734b-83aa-4887-b608-458b05391703 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1579 microversion: 2.1 time: 0.188367 Sep 24 20:00:15.604233 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 584/1127] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:15 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1579 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 20:00:16.581777 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [req-429c11e4-9bc7-45e8-b934-1fa18542c3f2 req-8e7d7a43-ef30-4d17-84af-b900b22474fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a26ea2-2640-4b3b-90e5-12b4496a9dbd", "name": "network-vif-deleted", "tag": "6af177a2-0d33-4754-a4cf-54505ac5dc26"}]} {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 20:00:16.593486 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-429c11e4-9bc7-45e8-b934-1fa18542c3f2 req-8e7d7a43-ef30-4d17-84af-b900b22474fa service nova] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:16.594087 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-429c11e4-9bc7-45e8-b934-1fa18542c3f2 req-8e7d7a43-ef30-4d17-84af-b900b22474fa service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:16.594625 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [req-429c11e4-9bc7-45e8-b934-1fa18542c3f2 req-8e7d7a43-ef30-4d17-84af-b900b22474fa service nova] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:16.607809 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.compute.server_external_events [req-429c11e4-9bc7-45e8-b934-1fa18542c3f2 req-8e7d7a43-ef30-4d17-84af-b900b22474fa service nova] Creating event network-vif-deleted:6af177a2-0d33-4754-a4cf-54505ac5dc26 for instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd on hv-cinder-85919 Sep 24 20:00:16.613409 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [req-429c11e4-9bc7-45e8-b934-1fa18542c3f2 req-8e7d7a43-ef30-4d17-84af-b900b22474fa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035027 Sep 24 20:00:16.614037 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 544/1128] 10.222.0.55 () {64 vars in 1317 bytes} [Sat Sep 24 20:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 20:00:16.629791 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:16.630693 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:16.638165 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:16.638664 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:16.639099 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:16.640090 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:16.640565 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:16.641000 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:16.718238 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.policy [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94533495d9ea4e489e7283dbf307ae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd308ae5684724251aa1011f269cf466a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127045) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 20:00:16.726858 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-738a3574-63bd-4856-8122-baac82785c71 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 200 len: 1226 microversion: 2.1 time: 0.101828 Sep 24 20:00:16.727452 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 585/1129] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:16 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 20:00:17.753897 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:17.754594 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 81a26ea2-2640-4b3b-90e5-12b4496a9dbd] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:17.761252 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:17.761772 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:17.762218 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:17.762926 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:17.763386 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:17.763842 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:17.779350 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] HTTP exception thrown: Instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd could not be found. Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Request method failure captured: Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd HTTP/1.1 Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL2Ai7uDBlfTWLDns2LFOdOIjTnaS8Fb6aq__Dd_MLO8MSQjWD4jJjazsmMOmV_SEfyjwnb3hJyMB9-srBFMmvyWRztECWVt0qX2QwMG2iDO-SaK9dNJXUXC8NHfAziDgmrIwCx-2h-GGkKUE3mE4cmVlJyNQnRFfJViSbHGmMLImj_M Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 20:00:17.781100 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d308ae5684724251aa1011f269cf466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d308ae5684724251aa1011f269cf466a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 94533495d9ea4e489e7283dbf307ae66 Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd could not be found. Sep 24 20:00:17.782679 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '81a26ea2-2640-4b3b-90e5-12b4496a9dbd'} Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd could not be found. Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:00:17.783604 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd could not be found. Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd could not be found. Sep 24 20:00:17.785042 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:17.786322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Returning 404 to user: Instance 81a26ea2-2640-4b3b-90e5-12b4496a9dbd could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:00:17.786322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-c6a5b5be-8147-45c8-9ceb-f0f6b411d3c4 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd" status: 404 len: 111 microversion: 2.1 time: 0.035237 Sep 24 20:00:17.786322 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 545/1130] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:17 2022] GET /compute/v2.1/servers/81a26ea2-2640-4b3b-90e5-12b4496a9dbd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:00:18.321471 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:18.322071 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.compute.api [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127045) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:18.330315 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:18.331278 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:18.331488 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:18.332652 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:18.332824 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:18.333200 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG oslo_concurrency.lockutils [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:18.352080 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.wsgi [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] HTTP exception thrown: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Request method failure captured: Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: request: DELETE /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 HTTP/1.1 Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept: application/json Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Accept-Encoding: identity Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Connection: close Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Length: 0 Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Content-Type: application/json Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Host: 10.222.0.55 Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: Openstack-System-Scope: None Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: User-Agent: python-urllib3/1.26.12 Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Auth-Token: gAAAAABjL2Ai7uDBlfTWLDns2LFOdOIjTnaS8Fb6aq__Dd_MLO8MSQjWD4jJjazsmMOmV_SEfyjwnb3hJyMB9-srBFMmvyWRztECWVt0qX2QwMG2iDO-SaK9dNJXUXC8NHfAziDgmrIwCx-2h-GGkKUE3mE4cmVlJyNQnRFfJViSbHGmMLImj_M Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Id: None Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Domain-Name: None Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Identity-Status: Confirmed Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Is-Admin-Project: True Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Id: default Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Domain-Name: Default Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Project-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Role: member,reader Sep 24 20:00:18.353799 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Roles: member,reader Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d308ae5684724251aa1011f269cf466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d308ae5684724251aa1011f269cf466a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-Tenant-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Id: default Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Domain-Name: Default Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Id: 94533495d9ea4e489e7283dbf307ae66 Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: X-User-Name: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: method: > Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: exception: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.355774 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: action_args: {'id': '3d1c0336-0f9c-4109-b44d-72fc095fed33'} Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:00:18.357323 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.359163 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.360927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Returning 404 to user: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. {{(pid=127045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:00:18.360927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-67887d22-3ab3-47ac-962c-9a0c23d961ca tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "DELETE /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 404 len: 111 microversion: 2.1 time: 0.037778 Sep 24 20:00:18.360927 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 586/1131] 10.222.0.55 () {58 vars in 1239 bytes} [Sat Sep 24 20:00:18 2022] DELETE /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:00:18.365535 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '>' {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:18.366365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.compute.api [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] [instance: 3d1c0336-0f9c-4109-b44d-72fc095fed33] Fetching instance by UUID {{(pid=127046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 20:00:18.374272 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:18.374922 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:18.375402 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:18.376319 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Acquiring lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 20:00:18.376892 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 20:00:18.377410 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG oslo_concurrency.lockutils [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Lock "ce5b2bd4-30da-4d83-a1f0-2f4fb3b64440" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 20:00:18.398935 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.wsgi [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] HTTP exception thrown: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Request method failure captured: Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: request: GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 HTTP/1.1 Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept: application/json Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Accept-Encoding: identity Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Connection: close Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Length: 0 Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Content-Type: application/json Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Host: 10.222.0.55 Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: Openstack-System-Scope: None Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: User-Agent: python-urllib3/1.26.12 Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Auth-Token: gAAAAABjL2Ai7uDBlfTWLDns2LFOdOIjTnaS8Fb6aq__Dd_MLO8MSQjWD4jJjazsmMOmV_SEfyjwnb3hJyMB9-srBFMmvyWRztECWVt0qX2QwMG2iDO-SaK9dNJXUXC8NHfAziDgmrIwCx-2h-GGkKUE3mE4cmVlJyNQnRFfJViSbHGmMLImj_M Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Id: None Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Domain-Name: None Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Identity-Status: Confirmed Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Is-Admin-Project: True Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Id: default Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Domain-Name: Default Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Project-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Role: member,reader Sep 24 20:00:18.402112 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Roles: member,reader Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.55:8080", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d308ae5684724251aa1011f269cf466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d308ae5684724251aa1011f269cf466a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d308ae5684724251aa1011f269cf466a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Id: d308ae5684724251aa1011f269cf466a Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-Tenant-Name: tempest-TestVolumeBootPattern-1939414081 Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Id: default Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Domain-Name: Default Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Id: 94533495d9ea4e489e7283dbf307ae66 Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: X-User-Name: tempest-TestVolumeBootPattern-1939414081-project Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: method: > Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: exception: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.404365 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: action_args: {'id': '3d1c0336-0f9c-4109-b44d-72fc095fed33'} Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: {{(pid=127046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 20:00:18.408524 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. Sep 24 20:00:18.410300 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: ERROR nova.api.openstack.wsgi Sep 24 20:00:18.412340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: DEBUG nova.api.openstack.wsgi [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Returning 404 to user: Instance 3d1c0336-0f9c-4109-b44d-72fc095fed33 could not be found. {{(pid=127046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 20:00:18.412340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: INFO nova.api.openstack.requestlog [None req-d8480511-2511-4148-bf9c-f556a58b3924 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33" status: 404 len: 111 microversion: 2.1 time: 0.044030 Sep 24 20:00:18.412340 dv-cinder-859191-1-iscsi devstack@n-api.service[127046]: [pid: 127046|app: 0|req: 546/1132] 10.222.0.55 () {58 vars in 1236 bytes} [Sat Sep 24 20:00:18 2022] GET /compute/v2.1/servers/3d1c0336-0f9c-4109-b44d-72fc095fed33 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 20:00:19.771779 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: DEBUG nova.api.openstack.wsgi [None req-3589ba63-f762-445f-98ae-a562912ff072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] Calling method '.version_select at 0x7f5417b59820>' {{(pid=127045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 20:00:19.813274 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: INFO nova.api.openstack.requestlog [None req-3589ba63-f762-445f-98ae-a562912ff072 tempest-TestVolumeBootPattern-1939414081 tempest-TestVolumeBootPattern-1939414081-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1412825204" status: 202 len: 0 microversion: 2.1 time: 0.048594 Sep 24 20:00:19.814447 dv-cinder-859191-1-iscsi devstack@n-api.service[127045]: [pid: 127045|app: 0|req: 587/1133] 10.222.0.55 () {58 vars in 1263 bytes} [Sat Sep 24 20:00:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1412825204 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)